Jun 26 10:34:02.314383 np0000003731 systemd[1]: Started devstack@n-cpu.service - Devstack devstack@n-cpu.service. Jun 26 10:34:03.926421 np0000003731 nova-compute[98967]: DEBUG os_vif [-] Loaded VIF plugin class '' with name 'noop' {{(pid=98967) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}} Jun 26 10:34:03.926993 np0000003731 nova-compute[98967]: DEBUG os_vif [-] Loaded VIF plugin class '' with name 'ovs' {{(pid=98967) initialize /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:54}} Jun 26 10:34:03.927186 np0000003731 nova-compute[98967]: INFO os_vif [-] Loaded VIF plugins: noop, ovs Jun 26 10:34:04.056034 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [-] Running cmd (subprocess): grep -F node.session.scan /sbin/iscsiadm {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:34:04.067556 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [-] CMD "grep -F node.session.scan /sbin/iscsiadm" returned: 0 in 0.012s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:34:04.112571 np0000003731 nova-compute[98967]: INFO oslo_service.periodic_task [-] Skipping periodic task _heal_instance_info_cache because its interval is negative Jun 26 10:34:04.845093 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] In native threading mode the number of concurrent builds, and snapshots should be limited to the same number. The current configuration has differing limits: max_concurrent_builds: 10, max_concurrent_snapshots: 5. Nova will use a single, overall limit of 10 for these tasks. Jun 26 10:34:04.845225 np0000003731 nova-compute[98967]: INFO nova.utils [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] The long task thread pool MainProcess.long_task is initialized Jun 26 10:34:04.845487 np0000003731 nova-compute[98967]: INFO nova.virt.driver [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Loading compute driver 'libvirt.LibvirtDriver' Jun 26 10:34:05.041641 np0000003731 nova-compute[98967]: INFO nova.compute.provider_config [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] No provider configs found in /etc/nova/provider_config/. If files are present, ensure the Nova process has access. Jun 26 10:34:05.543661 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Acquiring lock "singleton_lock" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:34:05.543767 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Acquired lock "singleton_lock" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:34:05.543963 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Releasing lock "singleton_lock" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:34:05.544198 np0000003731 nova-compute[98967]: WARNING oslo_service.backend._threading.service [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] no_fork=True: running service in main process Jun 26 10:34:05.544476 np0000003731 nova-compute[98967]: INFO nova.service [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Starting compute node (version 33.1.0) Jun 26 10:34:06.048721 np0000003731 nova-compute[98967]: INFO nova.utils [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] The default thread pool MainProcess.default is initialized Jun 26 10:34:06.049460 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:34:06.049717 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Starting event thread {{(pid=98967) start /opt/stack/nova/nova/virt/libvirt/host.py:251}} Jun 26 10:34:06.050069 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Starting connection event dispatch thread {{(pid=98967) _init_events /opt/stack/nova/nova/virt/libvirt/host.py:552}} Jun 26 10:34:06.050729 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Connecting to libvirt: qemu:///system {{(pid=98967) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:557}} Jun 26 10:34:06.755650 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Registering for lifecycle events {{(pid=98967) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:563}} Jun 26 10:34:06.758219 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Registering for connection events: {{(pid=98967) _get_new_connection /opt/stack/nova/nova/virt/libvirt/host.py:584}} Jun 26 10:34:06.759111 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Connection event '1' reason 'None' Jun 26 10:34:07.262599 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Cannot update service status on host "np0000003731" since it is not registered.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000003731 could not be found. Jun 26 10:34:07.263159 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.mount [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Initialising _HostMountState generation 0 {{(pid=98967) host_up /opt/stack/nova/nova/virt/libvirt/volume/mount.py:130}} Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host capabilities Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: 7f2a0776-2f14-4357-a22e-baa6677eb22e Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: x86_64 Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: EPYC-Milan Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: AMD Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: tcp Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: rdma Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.938775 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: 65844276 Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: 16461069 Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: 0 Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: 0 Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.941102 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: apparmor Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: 0 Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: dac Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: 0 Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: +64055:+993 Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: +64055:+993 Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: hvm Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: 64 Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-alpha Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: clipper Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: hvm Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: 32 Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-arm Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: virt-8.2 Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: virt Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: qcom-dc-scm-v1-bmc Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: mori-bmc Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: ast2600-evb Jun 26 10:34:16.942751 np0000003731 nova-compute[98967]: borzoi Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: tiogapass-bmc Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: spitz Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: virt-2.7 Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: nuri Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: mcimx7d-sabre Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: romulus-bmc Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: virt-3.0 Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: virt-5.0 Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: npcm750-evb Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: virt-2.10 Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: rainier-bmc Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: mps3-an547 Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: musca-b1 Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: realview-pbx-a9 Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: versatileab Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: kzm Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: virt-2.8 Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: fby35-bmc Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: musca-a Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: virt-3.1 Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: mcimx6ul-evk Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: virt-5.1 Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: smdkc210 Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: sx1 Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: virt-2.11 Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: imx25-pdk Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: stm32vldiscovery Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: virt-2.9 Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: orangepi-pc Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: quanta-q71l-bmc Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: z2 Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: virt-5.2 Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: xilinx-zynq-a9 Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: tosa Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: mps2-an500 Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: virt-2.12 Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: mps2-an521 Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: sabrelite Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: mps2-an511 Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: canon-a1100 Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: realview-eb Jun 26 10:34:16.944203 np0000003731 nova-compute[98967]: quanta-gbs-bmc Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: emcraft-sf2 Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: realview-pb-a8 Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: yosemitev2-bmc Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: virt-7.0 Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: virt-4.0 Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: raspi1ap Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: palmetto-bmc Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: sx1-v1 Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: n810 Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: g220a-bmc Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: n800 Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: bletchley-bmc Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: virt-7.1 Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: tacoma-bmc Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: virt-4.1 Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: quanta-gsj Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: versatilepb Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: terrier Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: mainstone Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: realview-eb-mpcore Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: integratorcp Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: virt-7.2 Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: supermicrox11-bmc Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: virt-4.2 Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: witherspoon-bmc Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: qcom-firework-bmc Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: mps3-an524 Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: kudo-bmc Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: vexpress-a9 Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: midway Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: musicpal Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: lm3s811evb Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: lm3s6965evb Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: supermicro-x11spi-bmc Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: microbit Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: fby35 Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: mps2-an505 Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: mps2-an385 Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: virt-6.0 Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: virt-8.0 Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: cubieboard Jun 26 10:34:16.945425 np0000003731 nova-compute[98967]: ast1030-evb Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: verdex Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: bpim2u Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: netduino2 Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: mps2-an386 Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: olimex-stm32-h405 Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: virt-6.1 Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: virt-8.1 Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: raspi2b Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: vexpress-a15 Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: fuji-bmc Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: virt-6.2 Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: sonorapass-bmc Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: cheetah Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: virt-2.6 Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: ast2500-evb Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: highbank Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: akita Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: connex Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: netduinoplus2 Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: collie Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: raspi0 Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: fp5280g2-bmc Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: hvm Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: 32 Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-arm Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: virt-8.2 Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: virt Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: qcom-dc-scm-v1-bmc Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: mori-bmc Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: ast2600-evb Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: borzoi Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: tiogapass-bmc Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: spitz Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: virt-2.7 Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: nuri Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: mcimx7d-sabre Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: romulus-bmc Jun 26 10:34:16.946636 np0000003731 nova-compute[98967]: virt-3.0 Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: virt-5.0 Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: npcm750-evb Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: virt-2.10 Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: rainier-bmc Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: mps3-an547 Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: musca-b1 Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: realview-pbx-a9 Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: versatileab Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: kzm Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: virt-2.8 Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: fby35-bmc Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: musca-a Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: virt-3.1 Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: mcimx6ul-evk Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: virt-5.1 Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: smdkc210 Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: sx1 Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: virt-2.11 Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: imx25-pdk Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: stm32vldiscovery Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: virt-2.9 Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: orangepi-pc Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: quanta-q71l-bmc Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: z2 Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: virt-5.2 Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: xilinx-zynq-a9 Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: tosa Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: mps2-an500 Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: virt-2.12 Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: mps2-an521 Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: sabrelite Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: mps2-an511 Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: canon-a1100 Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: realview-eb Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: quanta-gbs-bmc Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: emcraft-sf2 Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: realview-pb-a8 Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: yosemitev2-bmc Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: virt-7.0 Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: virt-4.0 Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: raspi1ap Jun 26 10:34:16.947979 np0000003731 nova-compute[98967]: palmetto-bmc Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: sx1-v1 Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: n810 Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: g220a-bmc Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: n800 Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: bletchley-bmc Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: virt-7.1 Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: tacoma-bmc Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: virt-4.1 Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: quanta-gsj Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: versatilepb Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: terrier Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: mainstone Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: realview-eb-mpcore Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: integratorcp Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: virt-7.2 Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: supermicrox11-bmc Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: virt-4.2 Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: witherspoon-bmc Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: qcom-firework-bmc Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: mps3-an524 Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: kudo-bmc Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: vexpress-a9 Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: midway Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: musicpal Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: lm3s811evb Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: lm3s6965evb Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: supermicro-x11spi-bmc Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: microbit Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: fby35 Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: mps2-an505 Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: mps2-an385 Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: virt-6.0 Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: virt-8.0 Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: cubieboard Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: ast1030-evb Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: verdex Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: bpim2u Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: netduino2 Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: mps2-an386 Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: olimex-stm32-h405 Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: virt-6.1 Jun 26 10:34:16.949122 np0000003731 nova-compute[98967]: virt-8.1 Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: raspi2b Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: vexpress-a15 Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: fuji-bmc Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: virt-6.2 Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: sonorapass-bmc Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: cheetah Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: virt-2.6 Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: ast2500-evb Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: highbank Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: akita Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: connex Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: netduinoplus2 Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: collie Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: raspi0 Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: fp5280g2-bmc Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: hvm Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: 64 Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-aarch64 Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: virt-8.2 Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: virt Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: qcom-dc-scm-v1-bmc Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: mori-bmc Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: ast2600-evb Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: borzoi Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: tiogapass-bmc Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: spitz Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: virt-2.7 Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: nuri Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: mcimx7d-sabre Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: romulus-bmc Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: virt-3.0 Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: virt-5.0 Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: npcm750-evb Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: virt-2.10 Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: rainier-bmc Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: mps3-an547 Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: virt-2.8 Jun 26 10:34:16.950297 np0000003731 nova-compute[98967]: musca-b1 Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: realview-pbx-a9 Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: versatileab Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: kzm Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: fby35-bmc Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: musca-a Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: virt-3.1 Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: mcimx6ul-evk Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: virt-5.1 Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: smdkc210 Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: sx1 Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: virt-2.11 Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: imx25-pdk Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: stm32vldiscovery Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: virt-2.9 Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: orangepi-pc Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: quanta-q71l-bmc Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: z2 Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: virt-5.2 Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: xilinx-zynq-a9 Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: xlnx-zcu102 Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: tosa Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: mps2-an500 Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: virt-2.12 Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: mps2-an521 Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: sabrelite Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: mps2-an511 Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: canon-a1100 Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: realview-eb Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: quanta-gbs-bmc Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: emcraft-sf2 Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: realview-pb-a8 Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: sbsa-ref Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: yosemitev2-bmc Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: virt-7.0 Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: virt-4.0 Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: raspi1ap Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: palmetto-bmc Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: sx1-v1 Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: n810 Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: g220a-bmc Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: n800 Jun 26 10:34:16.951703 np0000003731 nova-compute[98967]: bletchley-bmc Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: virt-7.1 Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: tacoma-bmc Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: virt-4.1 Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: quanta-gsj Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: versatilepb Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: terrier Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: mainstone Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: realview-eb-mpcore Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: integratorcp Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: virt-7.2 Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: supermicrox11-bmc Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: virt-4.2 Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: witherspoon-bmc Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: qcom-firework-bmc Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: mps3-an524 Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: kudo-bmc Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: vexpress-a9 Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: midway Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: musicpal Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: lm3s811evb Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: lm3s6965evb Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: supermicro-x11spi-bmc Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: microbit Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: fby35 Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: mps2-an505 Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: mps2-an385 Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: virt-6.0 Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: virt-8.0 Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: raspi3ap Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: cubieboard Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: ast1030-evb Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: verdex Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: bpim2u Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: netduino2 Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: xlnx-versal-virt Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: mps2-an386 Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: olimex-stm32-h405 Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: virt-6.1 Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: virt-8.1 Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: raspi3b Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: raspi2b Jun 26 10:34:16.952825 np0000003731 nova-compute[98967]: vexpress-a15 Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: fuji-bmc Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: virt-6.2 Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: sonorapass-bmc Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: cheetah Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: virt-2.6 Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: ast2500-evb Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: highbank Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: akita Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: connex Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: netduinoplus2 Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: collie Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: raspi0 Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: fp5280g2-bmc Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: hvm Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: 32 Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-cris Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: axis-dev88 Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: hvm Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: 32 Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-i386 Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: pc-i440fx-noble-v2 Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: ubuntu Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: pc-q35-mantic Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: pc-i440fx-impish-hpb Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: pc-q35-5.2 Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: pc-q35-lunar-hpb Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: pc-i440fx-mantic Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: pc-i440fx-2.12 Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: pc-i440fx-2.0 Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: pc-i440fx-xenial Jun 26 10:34:16.953953 np0000003731 nova-compute[98967]: pc-q35-kinetic Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-i440fx-6.2 Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-q35-4.2 Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-i440fx-mantic-maxcpus Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-i440fx-2.5 Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-i440fx-4.2 Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-i440fx-focal Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-i440fx-hirsute Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-q35-xenial Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-i440fx-jammy-hpb Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-i440fx-5.2 Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-q35-2.7 Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-q35-eoan-hpb Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-i440fx-disco-hpb Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-q35-groovy Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-i440fx-zesty Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-q35-lunar Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-q35-mantic-hpb-maxcpus Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-i440fx-groovy Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-q35-7.1 Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-q35-artful Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-i440fx-trusty Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-i440fx-2.2 Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-i440fx-eoan-hpb Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-q35-focal-hpb Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-q35-8.1 Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-q35-jammy-maxcpus Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-q35-bionic-hpb Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-q35-mantic-hpb Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-i440fx-artful Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-i440fx-8.1 Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-i440fx-2.7 Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-q35-6.1 Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-i440fx-kinetic Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-i440fx-jammy-maxcpus Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-i440fx-yakkety Jun 26 10:34:16.955385 np0000003731 nova-compute[98967]: pc-q35-2.4 Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-q35-cosmic-hpb Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-i440fx-7.1 Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-q35-2.10 Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: x-remote Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-q35-5.1 Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-q35-2.9 Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-i440fx-2.11 Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-i440fx-jammy-hpb-maxcpus Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-q35-3.1 Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-i440fx-6.1 Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-q35-4.1 Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-q35-jammy Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-i440fx-2.4 Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-i440fx-4.1 Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-q35-eoan Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-q35-jammy-hpb Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-i440fx-5.1 Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-i440fx-2.9 Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-i440fx-bionic-hpb Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-i440fx-lunar Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: isapc Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-i440fx-mantic-hpb Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-q35-cosmic Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-q35-2.6 Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-q35-mantic-maxcpus Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-i440fx-3.1 Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-q35-bionic Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-q35-disco-hpb Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-i440fx-cosmic Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-q35-2.12 Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-i440fx-bionic Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-q35-kinetic-hpb Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-q35-groovy-hpb Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-q35-7.0 Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-q35-noble-v2 Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: ubuntu-q35 Jun 26 10:34:16.956417 np0000003731 nova-compute[98967]: pc-i440fx-lunar-hpb Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-q35-disco Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-i440fx-cosmic-hpb Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-q35-noble Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: q35 Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-i440fx-2.1 Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-q35-8.0 Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-q35-impish Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-i440fx-wily Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-i440fx-8.0 Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-i440fx-2.6 Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-q35-6.0 Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-i440fx-impish Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-i440fx-jammy Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-q35-impish-hpb Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-q35-hirsute Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-q35-4.0.1 Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-q35-hirsute-hpb Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-i440fx-7.0 Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-q35-5.0 Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-q35-2.8 Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-i440fx-2.10 Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-q35-3.0 Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-i440fx-6.0 Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-q35-zesty Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-q35-7.2 Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-q35-4.0 Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-q35-focal Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: microvm Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-i440fx-2.3 Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-q35-jammy-hpb-maxcpus Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-q35-8.2 Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: q35 Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-i440fx-kinetic-hpb Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-i440fx-focal-hpb Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-i440fx-4.0 Jun 26 10:34:16.958652 np0000003731 nova-compute[98967]: pc-i440fx-noble Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: pc Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: pc-i440fx-disco Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: pc-i440fx-groovy-hpb Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: pc-i440fx-8.2 Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: pc Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: pc-i440fx-hirsute-hpb Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: pc-i440fx-5.0 Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: pc-q35-6.2 Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: pc-i440fx-2.8 Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: pc-i440fx-eoan Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: pc-q35-2.5 Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: pc-i440fx-3.0 Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: pc-q35-yakkety Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: pc-i440fx-mantic-hpb-maxcpus Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: pc-i440fx-7.2 Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: pc-q35-2.11 Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: hvm Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: 32 Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-m68k Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: mcf5208evb Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: virt-7.0 Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: an5206 Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: virt-6.0 Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: q800 Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: virt-8.1 Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: virt-7.2 Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: virt-6.2 Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: virt-8.0 Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: next-cube Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: virt-7.1 Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: virt-6.1 Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: virt-8.2 Jun 26 10:34:16.959761 np0000003731 nova-compute[98967]: virt Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: hvm Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: 32 Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-microblaze Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: petalogix-s3adsp1800 Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: petalogix-ml605 Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: xlnx-zynqmp-pmu Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: hvm Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: 32 Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-microblazeel Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: petalogix-s3adsp1800 Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: petalogix-ml605 Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: xlnx-zynqmp-pmu Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: hvm Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: 32 Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-mips Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: malta Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: mipssim Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: hvm Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: 32 Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-mipsel Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: malta Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: mipssim Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.961231 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: hvm Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: 64 Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-mips64 Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: malta Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: mipssim Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: pica61 Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: magnum Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: hvm Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: 64 Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-mips64el Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: malta Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: loongson3-virt Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: mipssim Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: pica61 Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: magnum Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: boston Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: fuloong2e Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: hvm Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: 32 Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-ppc Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: g3beige Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: amigaone Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: virtex-ml507 Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: mac99 Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: ppce500 Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: sam460ex Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: pegasos2 Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: bamboo Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: 40p Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: ref405ep Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: mpc8544ds Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.962679 np0000003731 nova-compute[98967]: Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: hvm Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: 64 Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-ppc64 Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: pseries-noble Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: pseries Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: amigaone Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: powernv9 Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: powernv Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: pseries-4.1 Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: mpc8544ds Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: pseries-6.1 Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: pseries-2.5 Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: powernv10 Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: pseries-xenial Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: pseries-4.2 Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: pseries-6.2 Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: pseries-yakkety Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: pseries-2.6 Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: ppce500 Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: pseries-bionic-sxxm Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: pseries-2.7 Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: pseries-3.0 Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: pseries-8.0 Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: pseries-5.0 Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: 40p Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: pseries-lunar Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: pseries-2.8 Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: pegasos2 Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: pseries-hirsute Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: pseries-3.1 Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: pseries-8.1 Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: pseries-5.1 Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: pseries-eoan Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: pseries-2.9 Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: pseries-zesty Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: bamboo Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: pseries-groovy Jun 26 10:34:16.963739 np0000003731 nova-compute[98967]: pseries-focal Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: g3beige Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: pseries-8.2 Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: pseries-5.2 Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: pseries-disco Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: pseries-2.12-sxxm Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: pseries-mantic Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: pseries-kinetic Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: pseries-2.10 Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: pseries-7.0 Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: virtex-ml507 Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: pseries-2.11 Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: pseries-2.1 Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: pseries-7.1 Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: pseries-cosmic Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: pseries-bionic Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: pseries-2.12 Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: pseries-2.2 Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: pseries-7.2 Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: mac99 Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: pseries-impish Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: pseries-jammy Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: pseries-artful Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: sam460ex Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: ref405ep Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: pseries-2.3 Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: powernv8 Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: pseries-4.0 Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: pseries-6.0 Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: pseries-2.4 Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: hvm Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: 64 Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-ppc64le Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: pseries-noble Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: pseries Jun 26 10:34:16.964625 np0000003731 nova-compute[98967]: amigaone Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: powernv9 Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: powernv Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pseries-4.1 Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: mpc8544ds Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pseries-6.1 Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pseries-2.5 Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: powernv10 Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pseries-xenial Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pseries-4.2 Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pseries-6.2 Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pseries-yakkety Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pseries-2.6 Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: ppce500 Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pseries-bionic-sxxm Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pseries-2.7 Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pseries-3.0 Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pseries-8.0 Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pseries-5.0 Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: 40p Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pseries-lunar Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pseries-2.8 Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pegasos2 Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pseries-hirsute Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pseries-3.1 Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pseries-8.1 Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pseries-5.1 Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pseries-eoan Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pseries-2.9 Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pseries-zesty Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: bamboo Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pseries-groovy Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pseries-focal Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: g3beige Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pseries-8.2 Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pseries-5.2 Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pseries-disco Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pseries-2.12-sxxm Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pseries-mantic Jun 26 10:34:16.965468 np0000003731 nova-compute[98967]: pseries-kinetic Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: pseries-2.10 Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: pseries-7.0 Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: virtex-ml507 Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: pseries-2.11 Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: pseries-2.1 Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: pseries-7.1 Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: pseries-cosmic Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: pseries-bionic Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: pseries-2.12 Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: pseries-2.2 Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: pseries-7.2 Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: mac99 Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: pseries-impish Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: pseries-jammy Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: pseries-artful Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: sam460ex Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: ref405ep Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: pseries-2.3 Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: powernv8 Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: pseries-4.0 Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: pseries-6.0 Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: pseries-2.4 Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: hvm Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: 32 Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-riscv32 Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: virt Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: spike Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: opentitan Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: sifive_u Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: sifive_e Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: hvm Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: 64 Jun 26 10:34:16.966075 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-riscv64 Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: virt Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: spike Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: microchip-icicle-kit Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: sifive_u Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: shakti_c Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: sifive_e Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: hvm Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: 64 Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-s390x Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: s390-ccw-virtio-noble Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: s390-ccw-virtio Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: s390-ccw-virtio-8.0 Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: s390-ccw-virtio-disco Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: s390-ccw-virtio-6.0 Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: s390-ccw-virtio-2.11 Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: s390-ccw-virtio-7.0 Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: s390-ccw-virtio-mantic Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: s390-ccw-virtio-xenial Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: s390-ccw-virtio-5.0 Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: s390-ccw-virtio-focal Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: s390-ccw-virtio-2.8 Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: s390-ccw-virtio-4.0 Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: s390-ccw-virtio-zesty Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: s390-ccw-virtio-8.2 Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: s390-ccw-virtio-6.2 Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: s390-ccw-virtio-3.0 Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: s390-ccw-virtio-groovy Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: s390-ccw-virtio-2.5 Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: s390-ccw-virtio-7.2 Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: s390-ccw-virtio-5.2 Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: s390-ccw-virtio-artful Jun 26 10:34:16.967024 np0000003731 nova-compute[98967]: s390-ccw-virtio-hirsute Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: s390-ccw-virtio-4.2 Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: s390-ccw-virtio-2.10 Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: s390-ccw-virtio-2.7 Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: s390-ccw-virtio-lunar Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: s390-ccw-virtio-eoan Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: s390-ccw-virtio-kinetic Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: s390-ccw-virtio-8.1 Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: s390-ccw-virtio-yakkety Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: s390-ccw-virtio-6.1 Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: s390-ccw-virtio-cosmic Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: s390-ccw-virtio-bionic Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: s390-ccw-virtio-2.12 Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: s390-ccw-virtio-7.1 Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: s390-ccw-virtio-2.4 Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: s390-ccw-virtio-5.1 Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: s390-ccw-virtio-2.9 Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: s390-ccw-virtio-impish Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: s390-ccw-virtio-4.1 Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: s390-ccw-virtio-jammy Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: s390-ccw-virtio-3.1 Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: s390-ccw-virtio-2.6 Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: hvm Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: 32 Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-sh4 Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: shix Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: r2d Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: hvm Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: 64 Jun 26 10:34:16.968397 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-sh4eb Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: shix Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: r2d Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: hvm Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: 32 Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-sparc Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: SS-5 Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: SS-20 Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: LX Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: SPARCClassic Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: leon3_generic Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: SPARCbook Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: SS-4 Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: SS-600MP Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: SS-10 Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Voyager Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: hvm Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: 64 Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-sparc64 Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: sun4u Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: niagara Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: sun4v Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: hvm Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: 64 Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-x86_64 Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: pc-i440fx-noble-v2 Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: ubuntu Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: pc-q35-mantic Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: pc-i440fx-impish-hpb Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: pc-q35-5.2 Jun 26 10:34:16.969365 np0000003731 nova-compute[98967]: pc-q35-lunar-hpb Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-i440fx-mantic Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-i440fx-2.12 Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-i440fx-2.0 Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-i440fx-xenial Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-q35-kinetic Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-i440fx-6.2 Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-q35-4.2 Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-i440fx-mantic-maxcpus Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-i440fx-2.5 Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-i440fx-4.2 Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-i440fx-focal Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-i440fx-hirsute Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-q35-xenial Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-i440fx-jammy-hpb Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-i440fx-5.2 Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-q35-2.7 Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-q35-eoan-hpb Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-i440fx-zesty Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-q35-groovy Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-i440fx-disco-hpb Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-q35-lunar Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-q35-mantic-hpb-maxcpus Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-i440fx-groovy Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-q35-7.1 Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-q35-artful Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-i440fx-trusty Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-i440fx-2.2 Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-q35-focal-hpb Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-q35-8.1 Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-i440fx-eoan-hpb Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-q35-jammy-maxcpus Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-q35-bionic-hpb Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-q35-mantic-hpb Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-i440fx-artful Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-i440fx-8.1 Jun 26 10:34:16.970448 np0000003731 nova-compute[98967]: pc-i440fx-2.7 Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-q35-6.1 Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-i440fx-kinetic Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-i440fx-jammy-maxcpus Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-i440fx-yakkety Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-q35-2.4 Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-q35-cosmic-hpb Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-i440fx-7.1 Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-q35-2.10 Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: x-remote Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-q35-5.1 Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-q35-2.9 Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-i440fx-2.11 Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-i440fx-jammy-hpb-maxcpus Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-q35-3.1 Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-i440fx-6.1 Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-q35-4.1 Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-q35-jammy Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-i440fx-2.4 Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-i440fx-4.1 Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-q35-eoan Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-q35-jammy-hpb Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-i440fx-5.1 Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-i440fx-2.9 Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-i440fx-bionic-hpb Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-i440fx-lunar Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: isapc Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-i440fx-mantic-hpb Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-q35-cosmic Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-q35-2.6 Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-q35-mantic-maxcpus Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-i440fx-3.1 Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-q35-bionic Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-q35-disco-hpb Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-i440fx-cosmic Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-q35-2.12 Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-i440fx-bionic Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-q35-kinetic-hpb Jun 26 10:34:16.971111 np0000003731 nova-compute[98967]: pc-q35-groovy-hpb Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-q35-7.0 Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-q35-noble-v2 Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: ubuntu-q35 Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-i440fx-lunar-hpb Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-q35-disco Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-i440fx-cosmic-hpb Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-i440fx-2.1 Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-q35-noble Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: q35 Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-q35-8.0 Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-i440fx-wily Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-q35-impish Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-i440fx-8.0 Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-i440fx-2.6 Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-q35-6.0 Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-i440fx-impish Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-i440fx-jammy Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-q35-impish-hpb Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-q35-hirsute Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-q35-4.0.1 Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-q35-hirsute-hpb Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-i440fx-7.0 Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-q35-5.0 Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-q35-2.8 Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-i440fx-2.10 Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-q35-3.0 Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-q35-zesty Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-q35-7.2 Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-q35-4.0 Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-i440fx-6.0 Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-q35-focal Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: microvm Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-i440fx-2.3 Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-q35-jammy-hpb-maxcpus Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-i440fx-disco Jun 26 10:34:16.971787 np0000003731 nova-compute[98967]: pc-i440fx-kinetic-hpb Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: pc-i440fx-4.0 Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: pc-i440fx-focal-hpb Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: pc-i440fx-noble Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: pc Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: pc-q35-8.2 Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: q35 Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: pc-i440fx-groovy-hpb Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: pc-i440fx-hirsute-hpb Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: pc-i440fx-8.2 Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: pc Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: pc-i440fx-5.0 Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: pc-i440fx-2.8 Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: pc-q35-6.2 Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: pc-i440fx-eoan Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: pc-q35-2.5 Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: pc-i440fx-3.0 Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: pc-q35-yakkety Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: pc-i440fx-mantic-hpb-maxcpus Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: pc-i440fx-7.2 Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: pc-q35-2.11 Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: hvm Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: 32 Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-xtensa Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: sim Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: kc705 Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: ml605 Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: ml605-nommu Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: virt Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: lx60-nommu Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: lx200 Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: lx200-nommu Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: lx60 Jun 26 10:34:16.972474 np0000003731 nova-compute[98967]: kc705-nommu Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: hvm Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: 32 Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-xtensaeb Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: sim Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: kc705 Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: ml605 Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: ml605-nommu Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: virt Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: lx60-nommu Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: lx200 Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: lx200-nommu Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: lx60 Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: kc705-nommu Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Getting domain capabilities for alpha via machine types: {None} {{(pid=98967) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=alpha and machine_type=None: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-alpha Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: clipper Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: alpha Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: rom Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: yes Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: no Jun 26 10:34:16.973270 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: no Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: file Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: disk Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: lun Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: usb Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: sata Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: spice Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: default Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: optional Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: usb Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: pci Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: Jun 26 10:34:16.974280 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: random Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: egd Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: path Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: handle Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: usb Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: pty Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: unix Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Getting domain capabilities for armv6l via machine types: {None, 'virt'} {{(pid=98967) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=None: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-arm Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: virt-8.2 Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: armv6l Jun 26 10:34:16.975663 np0000003731 nova-compute[98967]: Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: rom Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: yes Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: no Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: no Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: on Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: off Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: pxa270-c0 Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: cortex-a15 Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: pxa270-b0 Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: cortex-m4 Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: pxa270-a0 Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: arm1176 Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: pxa270-b1 Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: cortex-a7 Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: pxa270-a1 Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: cortex-a8 Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: cortex-r5 Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: ti925t Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: cortex-r5f Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: arm1026 Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: cortex-a9 Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: cortex-m7 Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: pxa270 Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: pxa260 Jun 26 10:34:16.976740 np0000003731 nova-compute[98967]: pxa250 Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: pxa270-c5 Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: pxa261 Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: pxa262 Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: sa1110 Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: cortex-r52 Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: sa1100 Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: max Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: cortex-m0 Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: cortex-m33 Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: arm946 Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: pxa255 Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: arm11mpcore Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: cortex-m55 Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: arm926 Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: arm1136 Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: arm1136-r2 Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: cortex-m3 Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: file Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: disk Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: lun Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: usb Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: sata Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: spice Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:16.977537 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: default Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: optional Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: usb Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: pci Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: random Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: egd Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: path Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: handle Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: tpm-tis Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: passthrough Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: emulator Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: external Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: 1.2 Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: 2.0 Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: usb Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: pty Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: unix Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.978523 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: 2 Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: 3 Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=armv6l and machine_type=virt: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-arm Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: virt-8.2 Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: armv6l Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: rom Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: yes Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: no Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: no Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: on Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: off Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: pxa270-c0 Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: cortex-a15 Jun 26 10:34:16.979830 np0000003731 nova-compute[98967]: pxa270-b0 Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: cortex-m4 Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: pxa270-a0 Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: arm1176 Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: pxa270-b1 Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: cortex-a7 Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: pxa270-a1 Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: cortex-a8 Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: cortex-r5 Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: ti925t Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: cortex-r5f Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: arm1026 Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: cortex-a9 Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: cortex-m7 Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: pxa270 Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: pxa260 Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: pxa250 Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: pxa270-c5 Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: pxa261 Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: pxa262 Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: sa1110 Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: cortex-r52 Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: sa1100 Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: max Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: cortex-m0 Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: cortex-m33 Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: arm946 Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: pxa255 Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: arm11mpcore Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: cortex-m55 Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: arm926 Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: arm1136 Jun 26 10:34:16.980864 np0000003731 nova-compute[98967]: arm1136-r2 Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: cortex-m3 Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: file Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: disk Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: lun Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: usb Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: sata Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: spice Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: default Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: optional Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: usb Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: pci Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: Jun 26 10:34:16.981418 np0000003731 nova-compute[98967]: random Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: egd Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: path Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: handle Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: tpm-tis Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: passthrough Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: emulator Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: external Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: 1.2 Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: 2.0 Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: usb Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: pty Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: unix Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: 2 Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: 3 Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:16.982743 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Getting domain capabilities for armv7l via machine types: {'virt'} {{(pid=98967) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=armv7l and machine_type=virt: Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-arm Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: virt-8.2 Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: armv7l Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: efi Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: rom Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: yes Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: no Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: no Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: on Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: off Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: pxa270-c0 Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: cortex-a15 Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: pxa270-b0 Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: cortex-m4 Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: pxa270-a0 Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: arm1176 Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: pxa270-b1 Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: cortex-a7 Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: pxa270-a1 Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: cortex-a8 Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: cortex-r5 Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: ti925t Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: cortex-r5f Jun 26 10:34:16.983849 np0000003731 nova-compute[98967]: arm1026 Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: cortex-a9 Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: cortex-m7 Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: pxa270 Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: pxa260 Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: pxa250 Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: pxa270-c5 Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: pxa261 Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: pxa262 Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: sa1110 Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: cortex-r52 Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: sa1100 Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: max Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: cortex-m0 Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: cortex-m33 Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: arm946 Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: pxa255 Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: arm11mpcore Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: cortex-m55 Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: arm926 Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: arm1136 Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: arm1136-r2 Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: cortex-m3 Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: file Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: disk Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: lun Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: usb Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: sata Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: Jun 26 10:34:16.984719 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: spice Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: default Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: optional Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: usb Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: pci Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: random Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: egd Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: path Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: handle Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: tpm-tis Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: passthrough Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: emulator Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: external Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: 1.2 Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: 2.0 Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: Jun 26 10:34:16.985516 np0000003731 nova-compute[98967]: usb Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: pty Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: unix Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: 2 Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: 3 Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Getting domain capabilities for aarch64 via machine types: {'virt'} {{(pid=98967) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=aarch64 and machine_type=virt: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-aarch64 Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: virt-8.2 Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: aarch64 Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: efi Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.ms.fd Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.secboot.fd Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.no-secboot.fd Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: rom Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:16.986735 np0000003731 nova-compute[98967]: Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: yes Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: no Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: no Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: on Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: off Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: neoverse-n2 Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: pxa270-c0 Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: cortex-a15 Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: pxa270-b0 Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: cortex-a57 Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: cortex-m4 Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: pxa270-a0 Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: arm1176 Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: pxa270-b1 Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: cortex-a7 Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: pxa270-a1 Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: cortex-a76 Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: a64fx Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: cortex-a8 Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: neoverse-v1 Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: cortex-r5 Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: ti925t Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: cortex-r5f Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: arm1026 Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: cortex-a9 Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: cortex-m7 Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: pxa270 Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: pxa260 Jun 26 10:34:16.987770 np0000003731 nova-compute[98967]: pxa250 Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: pxa270-c5 Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: pxa261 Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: pxa262 Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: cortex-a710 Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: sa1110 Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: cortex-r52 Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: sa1100 Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: max Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: cortex-a53 Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: cortex-m0 Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: cortex-m33 Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: cortex-a72 Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: arm946 Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: pxa255 Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: cortex-a55 Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: arm11mpcore Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: cortex-m55 Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: neoverse-n1 Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: arm926 Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: arm1136 Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: cortex-a35 Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: arm1136-r2 Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: cortex-m3 Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: file Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: disk Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: lun Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: usb Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: sata Jun 26 10:34:16.988525 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: spice Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: default Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: optional Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: usb Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: pci Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: random Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: egd Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: path Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: handle Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: tpm-tis Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: passthrough Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: emulator Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: external Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: 1.2 Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: 2.0 Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.989302 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: usb Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: pty Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: unix Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: 2 Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: 3 Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Getting domain capabilities for cris via machine types: {None} {{(pid=98967) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=cris and machine_type=None: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-cris Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: axis-dev88 Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: cris Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: rom Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: yes Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: no Jun 26 10:34:16.990565 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: no Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: file Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: disk Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: lun Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: spice Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: default Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: optional Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: pci Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: random Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: egd Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: path Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: handle Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.991646 np0000003731 nova-compute[98967]: Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: pty Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: unix Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:16.992988 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Getting domain capabilities for i686 via machine types: {'ubuntu', 'pc', 'q35', 'ubuntu-q35'} {{(pid=98967) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-i386 Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: pc-i440fx-noble-v2 Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: i686 Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: on Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: off Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: EPYC Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: AMD Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.106552 np0000003731 nova-compute[98967]: Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: qemu64 Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: qemu32 Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: phenom Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: pentium3 Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: pentium2 Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: pentium Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: n270 Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: kvm64 Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: kvm32 Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: coreduo Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: core2duo Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: athlon Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: Westmere-IBRS Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: Westmere Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: Snowridge Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: Skylake-Server-noTSX-IBRS Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: Skylake-Server-IBRS Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: Skylake-Server Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: Skylake-Client-noTSX-IBRS Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: Skylake-Client-IBRS Jun 26 10:34:17.108121 np0000003731 nova-compute[98967]: Skylake-Client Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: SapphireRapids Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: SandyBridge-IBRS Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: SandyBridge Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: Penryn Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: Opteron_G5 Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: Opteron_G4 Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: Opteron_G3 Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: Opteron_G2 Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: Opteron_G1 Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: Nehalem-IBRS Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: IvyBridge-IBRS Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: IvyBridge Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: Icelake-Server-noTSX Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: Icelake-Server Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: Haswell-noTSX-IBRS Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: Haswell-noTSX Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: Haswell-IBRS Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: Haswell Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: EPYC-Rome Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: EPYC-Milan Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: EPYC-IBPB Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: EPYC-Genoa Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: EPYC Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: Dhyana Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: Cooperlake Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: Conroe Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: Cascadelake-Server-noTSX Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: Cascadelake-Server Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: Broadwell-noTSX-IBRS Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: Broadwell-noTSX Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: Broadwell-IBRS Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: Broadwell Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: 486 Jun 26 10:34:17.109589 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: ide Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: sata Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: Jun 26 10:34:17.110785 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: tpm-tis Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: tpm-crb Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: passthrough Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: emulator Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: external Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: 1.2 Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: 2.0 Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: relaxed Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: vapic Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: spinlocks Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: vpindex Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: runtime Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: synic Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: stimer Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: reset Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: vendor_id Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: frequencies Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: reenlightenment Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: tlbflush Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: ipi Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: avic Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.112858 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=pc: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-i386 Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: pc-i440fx-noble Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: i686 Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: on Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: off Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: EPYC Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: AMD Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.114986 np0000003731 nova-compute[98967]: Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: qemu64 Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: qemu32 Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: phenom Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: pentium3 Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: pentium2 Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: pentium Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: n270 Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: kvm64 Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: kvm32 Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: coreduo Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: core2duo Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: athlon Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: Westmere-IBRS Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: Westmere Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: Snowridge Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: Skylake-Server-noTSX-IBRS Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: Skylake-Server-IBRS Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: Skylake-Server Jun 26 10:34:17.116388 np0000003731 nova-compute[98967]: Skylake-Client-noTSX-IBRS Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: Skylake-Client-IBRS Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: Skylake-Client Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: SapphireRapids Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: SandyBridge-IBRS Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: SandyBridge Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: Penryn Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: Opteron_G5 Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: Opteron_G4 Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: Opteron_G3 Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: Opteron_G2 Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: Opteron_G1 Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: Nehalem-IBRS Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: IvyBridge-IBRS Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: IvyBridge Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: Icelake-Server-noTSX Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: Icelake-Server Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: Haswell-noTSX-IBRS Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: Haswell-noTSX Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: Haswell-IBRS Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: Haswell Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: EPYC-Rome Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: EPYC-Milan Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: EPYC-IBPB Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: EPYC-Genoa Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: EPYC Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: Dhyana Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: Cooperlake Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: Conroe Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: Cascadelake-Server-noTSX Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: Cascadelake-Server Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: Broadwell-noTSX-IBRS Jun 26 10:34:17.117429 np0000003731 nova-compute[98967]: Broadwell-noTSX Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Broadwell-IBRS Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Broadwell Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: 486 Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: ide Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: sata Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.118293 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: tpm-tis Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: tpm-crb Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: passthrough Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: emulator Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: external Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: 1.2 Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: 2.0 Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: relaxed Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: vapic Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: spinlocks Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: vpindex Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: runtime Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: synic Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: stimer Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: reset Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: vendor_id Jun 26 10:34:17.120144 np0000003731 nova-compute[98967]: frequencies Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: reenlightenment Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: tlbflush Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: ipi Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: avic Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=q35: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-i386 Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: pc-q35-noble Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: i686 Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: on Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: off Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: EPYC Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: AMD Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.122178 np0000003731 nova-compute[98967]: Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: qemu64 Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: qemu32 Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: phenom Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: pentium3 Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: pentium2 Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: pentium Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: n270 Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: kvm64 Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: kvm32 Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: coreduo Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: core2duo Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: athlon Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: Westmere-IBRS Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: Westmere Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: Snowridge Jun 26 10:34:17.123815 np0000003731 nova-compute[98967]: Skylake-Server-noTSX-IBRS Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: Skylake-Server-IBRS Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: Skylake-Server Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: Skylake-Client-noTSX-IBRS Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: Skylake-Client-IBRS Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: Skylake-Client Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: SapphireRapids Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: SandyBridge-IBRS Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: SandyBridge Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: Penryn Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: Opteron_G5 Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: Opteron_G4 Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: Opteron_G3 Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: Opteron_G2 Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: Opteron_G1 Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: Nehalem-IBRS Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: IvyBridge-IBRS Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: IvyBridge Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: Icelake-Server-noTSX Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: Icelake-Server Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: Haswell-noTSX-IBRS Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: Haswell-noTSX Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: Haswell-IBRS Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: Haswell Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: EPYC-Rome Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: EPYC-Milan Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: EPYC-IBPB Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: EPYC-Genoa Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: EPYC Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: Dhyana Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: Cooperlake Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: Conroe Jun 26 10:34:17.124845 np0000003731 nova-compute[98967]: Cascadelake-Server-noTSX Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Cascadelake-Server Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Broadwell-noTSX-IBRS Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Broadwell-noTSX Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Broadwell-IBRS Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Broadwell Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: 486 Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: sata Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.125773 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: tpm-tis Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: tpm-crb Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: passthrough Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: emulator Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: external Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: 1.2 Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: 2.0 Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: relaxed Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: vapic Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: spinlocks Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: vpindex Jun 26 10:34:17.127604 np0000003731 nova-compute[98967]: runtime Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: synic Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: stimer Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: reset Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: vendor_id Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: frequencies Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: reenlightenment Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: tlbflush Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: ipi Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: avic Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=i686 and machine_type=ubuntu-q35: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-i386 Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: pc-q35-noble-v2 Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: i686 Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: on Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: off Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: EPYC Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: AMD Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.129673 np0000003731 nova-compute[98967]: Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: qemu64 Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: qemu32 Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: phenom Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: pentium3 Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: pentium2 Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: pentium Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: n270 Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: kvm64 Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: kvm32 Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: coreduo Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: core2duo Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: athlon Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: Westmere-IBRS Jun 26 10:34:17.131323 np0000003731 nova-compute[98967]: Westmere Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: Snowridge Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: Skylake-Server-noTSX-IBRS Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: Skylake-Server-IBRS Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: Skylake-Server Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: Skylake-Client-noTSX-IBRS Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: Skylake-Client-IBRS Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: Skylake-Client Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: SapphireRapids Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: SandyBridge-IBRS Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: SandyBridge Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: Penryn Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: Opteron_G5 Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: Opteron_G4 Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: Opteron_G3 Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: Opteron_G2 Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: Opteron_G1 Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: Nehalem-IBRS Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: IvyBridge-IBRS Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: IvyBridge Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: Icelake-Server-noTSX Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: Icelake-Server Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: Haswell-noTSX-IBRS Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: Haswell-noTSX Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: Haswell-IBRS Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: Haswell Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: EPYC-Rome Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: EPYC-Milan Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: EPYC-IBPB Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: EPYC-Genoa Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: EPYC Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: Dhyana Jun 26 10:34:17.132396 np0000003731 nova-compute[98967]: Cooperlake Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Conroe Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Cascadelake-Server-noTSX Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Cascadelake-Server Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Broadwell-noTSX-IBRS Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Broadwell-noTSX Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Broadwell-IBRS Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Broadwell Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: 486 Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: sata Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.133262 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: tpm-tis Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: tpm-crb Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: passthrough Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: emulator Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: external Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: 1.2 Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: 2.0 Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.134999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: relaxed Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: vapic Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: spinlocks Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: vpindex Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: runtime Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: synic Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: stimer Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: reset Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: vendor_id Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: frequencies Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: reenlightenment Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: tlbflush Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: ipi Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: avic Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Getting domain capabilities for m68k via machine types: {None, 'virt'} {{(pid=98967) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=None: Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-m68k Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: mcf5208evb Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: m68k Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.137149 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.138669 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=m68k and machine_type=virt: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-m68k Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: virt-8.2 Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: m68k Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: Jun 26 10:34:17.140812 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.142629 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Getting domain capabilities for microblaze via machine types: {None} {{(pid=98967) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=microblaze and machine_type=None: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-microblaze Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: petalogix-s3adsp1800 Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: microblaze Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: Jun 26 10:34:17.144753 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.146269 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Getting domain capabilities for microblazeel via machine types: {None} {{(pid=98967) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=microblazeel and machine_type=None: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-microblazeel Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: petalogix-s3adsp1800 Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: microblazeel Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.148599 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: Jun 26 10:34:17.150173 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Getting domain capabilities for mips via machine types: {None} {{(pid=98967) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=mips and machine_type=None: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-mips Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: malta Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: mips Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: ide Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: sata Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.152415 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: Jun 26 10:34:17.154054 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Getting domain capabilities for mipsel via machine types: {None} {{(pid=98967) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=mipsel and machine_type=None: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-mipsel Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: malta Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: mipsel Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: Jun 26 10:34:17.156075 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: ide Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: sata Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.157649 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Getting domain capabilities for mips64 via machine types: {None} {{(pid=98967) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=mips64 and machine_type=None: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-mips64 Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: malta Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: mips64 Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.159707 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: ide Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: sata Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.161346 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Getting domain capabilities for mips64el via machine types: {None} {{(pid=98967) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=mips64el and machine_type=None: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-mips64el Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: malta Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: mips64el Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.163334 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: ide Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: sata Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.164984 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: Jun 26 10:34:17.166985 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Getting domain capabilities for ppc via machine types: {None} {{(pid=98967) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=ppc and machine_type=None: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-ppc Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: g3beige Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: ppc Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: ide Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: sata Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.168811 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.170450 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Getting domain capabilities for ppc64 via machine types: {None, 'powernv', 'pseries'} {{(pid=98967) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=None: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-ppc64 Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: pseries-noble Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: ppc64 Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: POWER10 Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: POWER9 Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: POWER8 Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: POWER7 Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.172504 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: sata Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:17.173962 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: tpm-spapr Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: spapr-tpm-proxy Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: passthrough Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: emulator Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: external Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: 1.2 Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: 2.0 Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=powernv: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-ppc64 Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: powernv9 Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: ppc64 Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.175867 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: POWER10 Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: POWER9 Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: POWER8 Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: POWER7 Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: sata Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.177975 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: tpm-spapr Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: spapr-tpm-proxy Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: passthrough Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: emulator Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: external Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: 1.2 Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: 2.0 Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.179941 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=ppc64 and machine_type=pseries: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-ppc64 Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: pseries-noble Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: ppc64 Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: POWER10 Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: POWER9 Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: POWER8 Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: POWER7 Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: sata Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.181999 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: tpm-spapr Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: spapr-tpm-proxy Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: passthrough Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: emulator Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: external Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: 1.2 Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: 2.0 Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.183584 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Getting domain capabilities for ppc64le via machine types: {'powernv', 'pseries'} {{(pid=98967) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=powernv: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-ppc64le Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: powernv9 Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: ppc64le Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.186158 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: POWER10 Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: POWER9 Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: POWER8 Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: POWER7 Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: sata Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.187739 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: tpm-spapr Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: spapr-tpm-proxy Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: passthrough Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: emulator Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: external Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: 1.2 Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: 2.0 Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.189569 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=ppc64le and machine_type=pseries: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-ppc64le Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: pseries-noble Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: ppc64le Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: POWER10 Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: POWER9 Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: POWER8 Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: POWER7 Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: sata Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.191298 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: tpm-spapr Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: spapr-tpm-proxy Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: passthrough Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: emulator Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: external Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: 1.2 Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: 2.0 Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.193095 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Getting domain capabilities for riscv32 via machine types: {None} {{(pid=98967) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=riscv32 and machine_type=None: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-riscv32 Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: virt Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: riscv32 Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: on Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: off Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: Jun 26 10:34:17.195048 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: sata Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: Jun 26 10:34:17.196534 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: tpm-tis Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: passthrough Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: emulator Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: external Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: 1.2 Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: 2.0 Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Getting domain capabilities for riscv64 via machine types: {None} {{(pid=98967) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=riscv64 and machine_type=None: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-riscv64 Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: virt Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: riscv64 Jun 26 10:34:17.198437 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: on Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: off Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: rv64 Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: sifive-e51 Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: any Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: x-rv128 Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: shakti-c Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: max Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: thead-c906 Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: sifive-u54 Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: veyron-v1 Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: sata Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.200025 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: tpm-tis Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: passthrough Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: emulator Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: external Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: 1.2 Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: 2.0 Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.201655 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Getting domain capabilities for s390x via machine types: {'s390-ccw-virtio'} {{(pid=98967) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=s390x and machine_type=s390-ccw-virtio: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-s390x Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: s390-ccw-virtio-noble Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: s390x Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.203634 np0000003731 nova-compute[98967]: Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: on Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: off Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: z13 Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: z990.3 Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: z13-base Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: z990.2 Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: z196.2-base Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: z14 Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: z14.2-base Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: z990.4 Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: z196 Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: z10BC.2-base Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: z114-base Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: gen16b Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: z890.3-base Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: gen16a Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: z990.5 Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: z196.2 Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: zEC12 Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: zEC12.2 Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: z9EC.2 Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: z9BC Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: z9EC.3-base Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: z800-base Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: z14ZR1-base Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: z890 Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: z990.4-base Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: z9EC.3 Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: z13.2 Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: z10BC.2 Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: gen15a-base Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: z14.2 Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: zBC12-base Jun 26 10:34:17.205111 np0000003731 nova-compute[98967]: gen16a-base Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: z900.3 Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: z196-base Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: z990 Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: z14-base Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: z900.2 Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: z800 Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: z10EC Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: z14ZR1 Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: z900 Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: z10EC.2 Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: z10EC.2-base Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: z900.2-base Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: z900-base Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: z10EC.3 Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: z990.5-base Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: max Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: gen15b Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: z9BC.2-base Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: gen15a Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: z990.2-base Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: z10EC-base Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: gen16b-base Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: z114 Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: z9EC-base Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: z13s Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: gen15b-base Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: zEC12-base Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: z890.3 Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: z10EC.3-base Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: z890.2-base Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: z890.2 Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: z10BC-base Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: zEC12.2-base Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: z890-base Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: z9BC-base Jun 26 10:34:17.206244 np0000003731 nova-compute[98967]: z10BC Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: z9EC Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: z9EC.2-base Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: z13.2-base Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: z900.3-base Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: z990.3-base Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: z13s-base Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: zBC12 Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: z990-base Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: z9BC.2 Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: Jun 26 10:34:17.207351 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Getting domain capabilities for sh4 via machine types: {None} {{(pid=98967) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 26 10:34:17.209059 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=sh4 and machine_type=None: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-sh4 Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: shix Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: sh4 Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: sata Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.210577 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: Jun 26 10:34:17.212511 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Getting domain capabilities for sh4eb via machine types: {None} {{(pid=98967) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=sh4eb and machine_type=None: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-sh4eb Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: shix Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: sh4eb Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: sata Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.214331 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.215826 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Getting domain capabilities for sparc via machine types: {None} {{(pid=98967) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=sparc and machine_type=None: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-sparc Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: SS-5 Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: sparc Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.218406 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.220025 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Getting domain capabilities for sparc64 via machine types: {None} {{(pid=98967) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=sparc64 and machine_type=None: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-sparc64 Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: sun4u Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: sparc64 Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: ide Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:17.222044 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: sata Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.223488 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Getting domain capabilities for x86_64 via machine types: {'ubuntu', 'pc', 'q35', 'ubuntu-q35'} {{(pid=98967) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-x86_64 Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: pc-i440fx-noble-v2 Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: x86_64 Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: efi Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: /usr/share/OVMF/OVMF_CODE_4M.fd Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: on Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: off Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.225372 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: EPYC Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: AMD Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: qemu64 Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: qemu32 Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: phenom Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: pentium3 Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: pentium2 Jun 26 10:34:17.226866 np0000003731 nova-compute[98967]: pentium Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: n270 Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: kvm64 Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: kvm32 Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: coreduo Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: core2duo Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: athlon Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: Westmere-IBRS Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: Westmere Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: Snowridge Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: Skylake-Server-noTSX-IBRS Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: Skylake-Server-IBRS Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: Skylake-Server Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: Skylake-Client-noTSX-IBRS Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: Skylake-Client-IBRS Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: Skylake-Client Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: SapphireRapids Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: SandyBridge-IBRS Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: SandyBridge Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: Penryn Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: Opteron_G5 Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: Opteron_G4 Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: Opteron_G3 Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: Opteron_G2 Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: Opteron_G1 Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: Nehalem-IBRS Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: IvyBridge-IBRS Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: IvyBridge Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: Icelake-Server-noTSX Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: Icelake-Server Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: Haswell-noTSX-IBRS Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: Haswell-noTSX Jun 26 10:34:17.228075 np0000003731 nova-compute[98967]: Haswell-IBRS Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: Haswell Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: EPYC-Rome Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: EPYC-Milan Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: EPYC-IBPB Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: EPYC-Genoa Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: EPYC Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: Dhyana Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: Cooperlake Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: Conroe Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: Cascadelake-Server-noTSX Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: Cascadelake-Server Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: Broadwell-noTSX-IBRS Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: Broadwell-noTSX Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: Broadwell-IBRS Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: Broadwell Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: 486 Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: ide Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: sata Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: Jun 26 10:34:17.228982 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: tpm-tis Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: tpm-crb Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: passthrough Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: emulator Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: external Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: 1.2 Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: 2.0 Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: Jun 26 10:34:17.230463 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: relaxed Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: vapic Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: spinlocks Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: vpindex Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: runtime Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: synic Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: stimer Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: reset Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: vendor_id Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: frequencies Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: reenlightenment Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: tlbflush Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: ipi Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: avic Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=pc: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-x86_64 Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: pc-i440fx-noble Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: x86_64 Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: efi Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: /usr/share/OVMF/OVMF_CODE_4M.fd Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.232434 np0000003731 nova-compute[98967]: on Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: off Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: EPYC Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: AMD Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: qemu64 Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: qemu32 Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: phenom Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: pentium3 Jun 26 10:34:17.234151 np0000003731 nova-compute[98967]: pentium2 Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: pentium Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: n270 Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: kvm64 Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: kvm32 Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: coreduo Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: core2duo Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: athlon Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: Westmere-IBRS Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: Westmere Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: Snowridge Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: Skylake-Server-noTSX-IBRS Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: Skylake-Server-IBRS Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: Skylake-Server Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: Skylake-Client-noTSX-IBRS Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: Skylake-Client-IBRS Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: Skylake-Client Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: SapphireRapids Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: SandyBridge-IBRS Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: SandyBridge Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: Penryn Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: Opteron_G5 Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: Opteron_G4 Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: Opteron_G3 Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: Opteron_G2 Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: Opteron_G1 Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: Nehalem-IBRS Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: IvyBridge-IBRS Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: IvyBridge Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: Icelake-Server-noTSX Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: Icelake-Server Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: Haswell-noTSX-IBRS Jun 26 10:34:17.235290 np0000003731 nova-compute[98967]: Haswell-noTSX Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Haswell-IBRS Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Haswell Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: EPYC-Rome Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: EPYC-Milan Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: EPYC-IBPB Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: EPYC-Genoa Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: EPYC Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Dhyana Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Cooperlake Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Conroe Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Cascadelake-Server-noTSX Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Cascadelake-Server Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Broadwell-noTSX-IBRS Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Broadwell-noTSX Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Broadwell-IBRS Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Broadwell Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: 486 Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: ide Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: sata Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Jun 26 10:34:17.236110 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: tpm-tis Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: tpm-crb Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: passthrough Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: emulator Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: external Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: 1.2 Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: 2.0 Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: Jun 26 10:34:17.237555 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: relaxed Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: vapic Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: spinlocks Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: vpindex Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: runtime Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: synic Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: stimer Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: reset Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: vendor_id Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: frequencies Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: reenlightenment Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: tlbflush Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: ipi Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: avic Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=q35: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-x86_64 Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: pc-q35-noble Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: x86_64 Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: efi Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: /usr/share/OVMF/OVMF_CODE_4M.ms.fd Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: /usr/share/OVMF/OVMF_CODE_4M.secboot.fd Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: /usr/share/ovmf/OVMF.amdsev.fd Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: /usr/share/OVMF/OVMF_CODE_4M.fd Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.239495 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: on Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: off Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: EPYC Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: AMD Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.240764 np0000003731 nova-compute[98967]: Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: qemu64 Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: qemu32 Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: phenom Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: pentium3 Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: pentium2 Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: pentium Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: n270 Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: kvm64 Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: kvm32 Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: coreduo Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: core2duo Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: athlon Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: Westmere-IBRS Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: Westmere Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: Snowridge Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: Skylake-Server-noTSX-IBRS Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: Skylake-Server-IBRS Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: Skylake-Server Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: Skylake-Client-noTSX-IBRS Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: Skylake-Client-IBRS Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: Skylake-Client Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: SapphireRapids Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: SandyBridge-IBRS Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: SandyBridge Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: Penryn Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: Opteron_G5 Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: Opteron_G4 Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: Opteron_G3 Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: Opteron_G2 Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: Opteron_G1 Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: Nehalem-IBRS Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: IvyBridge-IBRS Jun 26 10:34:17.241533 np0000003731 nova-compute[98967]: IvyBridge Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Icelake-Server-noTSX Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Icelake-Server Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Haswell-noTSX-IBRS Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Haswell-noTSX Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Haswell-IBRS Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Haswell Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: EPYC-Rome Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: EPYC-Milan Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: EPYC-IBPB Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: EPYC-Genoa Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: EPYC Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Dhyana Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Cooperlake Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Conroe Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Cascadelake-Server-noTSX Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Cascadelake-Server Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Broadwell-noTSX-IBRS Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Broadwell-noTSX Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Broadwell-IBRS Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Broadwell Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: 486 Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: sata Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Jun 26 10:34:17.242060 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: tpm-tis Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: tpm-crb Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: passthrough Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: emulator Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: external Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: 1.2 Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: 2.0 Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.243036 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: relaxed Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: vapic Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: spinlocks Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: vpindex Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: runtime Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: synic Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: stimer Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: reset Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: vendor_id Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: frequencies Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: reenlightenment Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: tlbflush Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: ipi Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: avic Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=x86_64 and machine_type=ubuntu-q35: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-x86_64 Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: pc-q35-noble-v2 Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: x86_64 Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: efi Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: /usr/share/OVMF/OVMF_CODE_4M.ms.fd Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: /usr/share/OVMF/OVMF_CODE_4M.secboot.fd Jun 26 10:34:17.244247 np0000003731 nova-compute[98967]: /usr/share/ovmf/OVMF.amdsev.fd Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: /usr/share/OVMF/OVMF_CODE_4M.fd Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: on Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: off Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: EPYC Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: AMD Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.245353 np0000003731 nova-compute[98967]: Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: qemu64 Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: qemu32 Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: phenom Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: pentium3 Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: pentium2 Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: pentium Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: n270 Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: kvm64 Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: kvm32 Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: coreduo Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: core2duo Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: athlon Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: Westmere-IBRS Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: Westmere Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: Snowridge Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: Skylake-Server-noTSX-IBRS Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: Skylake-Server-IBRS Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: Skylake-Server Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: Skylake-Client-noTSX-IBRS Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: Skylake-Client-IBRS Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: Skylake-Client Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: SapphireRapids Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: SandyBridge-IBRS Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: SandyBridge Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: Penryn Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: Opteron_G5 Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: Opteron_G4 Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: Opteron_G3 Jun 26 10:34:17.246211 np0000003731 nova-compute[98967]: Opteron_G2 Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: Opteron_G1 Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: Nehalem-IBRS Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: IvyBridge-IBRS Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: IvyBridge Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: Icelake-Server-noTSX Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: Icelake-Server Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: Haswell-noTSX-IBRS Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: Haswell-noTSX Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: Haswell-IBRS Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: Haswell Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: EPYC-Rome Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: EPYC-Milan Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: EPYC-IBPB Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: EPYC-Genoa Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: EPYC Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: Dhyana Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: Cooperlake Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: Conroe Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: Cascadelake-Server-noTSX Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: Cascadelake-Server Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: Broadwell-noTSX-IBRS Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: Broadwell-noTSX Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: Broadwell-IBRS Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: Broadwell Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: 486 Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:17.246735 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: sata Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: tpm-tis Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: tpm-crb Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: passthrough Jun 26 10:34:17.247434 np0000003731 nova-compute[98967]: emulator Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: external Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: 1.2 Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: 2.0 Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: relaxed Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: vapic Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: spinlocks Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: vpindex Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: runtime Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: synic Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: stimer Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: reset Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: vendor_id Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: frequencies Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: reenlightenment Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: tlbflush Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: ipi Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: avic Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.248568 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Getting domain capabilities for xtensa via machine types: {None} {{(pid=98967) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=xtensa and machine_type=None: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-xtensa Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: sim Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: xtensa Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: sata Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.249525 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.250611 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Getting domain capabilities for xtensaeb via machine types: {None} {{(pid=98967) _get_machine_types /opt/stack/nova/nova/virt/libvirt/host.py:1019}} Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt host hypervisor capabilities for arch=xtensaeb and machine_type=None: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-xtensaeb Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: sim Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: xtensaeb Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF_CODE.fd Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: /usr/share/AAVMF/AAVMF32_CODE.fd Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: rom Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: pflash Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: yes Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: no Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: file Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: anonymous Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: memfd Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: disk Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: cdrom Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: floppy Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: lun Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: fdc Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: sata Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: Jun 26 10:34:17.251777 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: sdl Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: vnc Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: spice Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: egl-headless Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: dbus Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: subsystem Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: default Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: mandatory Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: requisite Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: optional Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: pci Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: scsi Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: virtio-transitional Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: virtio-non-transitional Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: random Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: egd Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: path Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: handle Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: virtiofs Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: usb Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: pty Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: unix Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: spicevmc Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: virtio Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: qemu Jun 26 10:34:17.252848 np0000003731 nova-compute[98967]: Jun 26 10:34:17.254144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.254144 np0000003731 nova-compute[98967]: builtin Jun 26 10:34:17.254144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.254144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.254144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.254144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.254144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.254144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.254144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.254144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.254144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.254144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.254144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.254144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.254144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.254144 np0000003731 nova-compute[98967]: Jun 26 10:34:17.254144 np0000003731 nova-compute[98967]: {{(pid=98967) _get_domain_capabilities /opt/stack/nova/nova/virt/libvirt/host.py:1104}} Jun 26 10:34:17.254144 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Checking secure boot support for host arch (x86_64) {{(pid=98967) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1961}} Jun 26 10:34:17.254144 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Checking secure boot support for host arch (x86_64) {{(pid=98967) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1961}} Jun 26 10:34:17.254144 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Checking secure boot support for host arch (x86_64) {{(pid=98967) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1961}} Jun 26 10:34:17.254144 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Checking secure boot support for host arch (x86_64) {{(pid=98967) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1961}} Jun 26 10:34:17.254144 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Checking secure boot support for host arch (x86_64) {{(pid=98967) supports_secure_boot /opt/stack/nova/nova/virt/libvirt/host.py:1961}} Jun 26 10:34:17.254144 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Secure Boot support detected Jun 26 10:34:17.687401 np0000003731 nova-compute[98967]: INFO nova.virt.node [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Generated node identity 7149a1d0-8a83-4b86-a06a-b678e317ee9d Jun 26 10:34:17.687537 np0000003731 nova-compute[98967]: INFO nova.virt.node [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Wrote node identity 7149a1d0-8a83-4b86-a06a-b678e317ee9d to /opt/stack/data/nova/compute_id Jun 26 10:34:18.189577 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Compute nodes ['7149a1d0-8a83-4b86-a06a-b678e317ee9d'] for host np0000003731 were not found in the database. If this is the first time this service is starting on this host, then you can ignore this warning. Jun 26 10:34:19.192931 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Looking for unclaimed instances stuck in BUILDING status for nodes managed by this host Jun 26 10:34:20.201935 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] No compute node record found for host np0000003731. If this is the first time this service is starting on this host, then you can ignore this warning.: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host np0000003731 could not be found. Jun 26 10:34:20.202409 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:34:20.202409 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:34:20.202409 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:34:20.202503 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Auditing locally available compute resources for np0000003731 (node: np0000003731) {{(pid=98967) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 26 10:34:20.265889 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:34:20.266462 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:34:20.278718 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] CMD "env LANG=C uptime" returned: 0 in 0.012s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:34:20.279046 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Hypervisor/Node resource view: name=np0000003731 free_ram=55566MB free_disk=75.21212768554688GB free_vcpus=16 pci_devices=[{"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98967) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 26 10:34:20.279199 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:34:20.279449 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:34:20.782086 np0000003731 nova-compute[98967]: WARNING nova.compute.resource_tracker [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] No compute node record for np0000003731:7149a1d0-8a83-4b86-a06a-b678e317ee9d: nova.exception_Remote.ComputeHostNotFound_Remote: Compute host 7149a1d0-8a83-4b86-a06a-b678e317ee9d could not be found. Jun 26 10:34:21.286214 np0000003731 nova-compute[98967]: INFO nova.compute.resource_tracker [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Compute node record created for np0000003731:np0000003731 with uuid: 7149a1d0-8a83-4b86-a06a-b678e317ee9d Jun 26 10:34:22.792877 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Total usable vcpus: 16, total allocated vcpus: 0 {{(pid=98967) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 26 10:34:22.793289 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Final resource view: name=np0000003731 phys_ram=64301MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 10:34:20 up 23 min, 2 users, load average: 3.02, 1.90, 1.00\n'} {{(pid=98967) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 26 10:34:23.236111 np0000003731 nova-compute[98967]: INFO nova.scheduler.client.report [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] [req-09697851-6344-460d-81bd-1145e2c80249] Created resource provider record via placement API for resource provider with UUID 7149a1d0-8a83-4b86-a06a-b678e317ee9d and name np0000003731. Jun 26 10:34:23.296776 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] /sys/module/kvm_amd/parameters/sev contains [N Jun 26 10:34:23.296776 np0000003731 nova-compute[98967]: ] {{(pid=98967) _kernel_supports_amd_sev /opt/stack/nova/nova/virt/libvirt/host.py:2037}} Jun 26 10:34:23.296914 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.host [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] kernel doesn't support AMD SEV Jun 26 10:34:23.297200 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:34:23.297399 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Updating inventory in ProviderTree for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d with inventory: {'MEMORY_MB': {'total': 64301, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 16, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Jun 26 10:34:23.297691 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:34:23.301403 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Libvirt baseline CPU Jun 26 10:34:23.301403 np0000003731 nova-compute[98967]: x86_64 Jun 26 10:34:23.301403 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:34:23.301403 np0000003731 nova-compute[98967]: AMD Jun 26 10:34:23.301403 np0000003731 nova-compute[98967]: Jun 26 10:34:23.301403 np0000003731 nova-compute[98967]: Jun 26 10:34:23.301403 np0000003731 nova-compute[98967]: Jun 26 10:34:23.301403 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_baseline_cpu_features /opt/stack/nova/nova/virt/libvirt/driver.py:13761}} Jun 26 10:34:23.878077 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Updated inventory for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d with generation 0 in Placement from set_inventory_for_provider using data: {'MEMORY_MB': {'total': 64301, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 512}, 'VCPU': {'total': 16, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0, 'reserved': 0}, 'DISK_GB': {'total': 95, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0, 'reserved': 0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:975}} Jun 26 10:34:23.878596 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Updating resource provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d generation from 0 to 1 during operation: update_inventory {{(pid=98967) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}} Jun 26 10:34:23.878596 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Updating inventory in ProviderTree for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d with inventory: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Jun 26 10:34:24.034174 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Updating resource provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d generation from 1 to 2 during operation: update_traits {{(pid=98967) _update_generation /opt/stack/nova/nova/compute/provider_tree.py:164}} Jun 26 10:34:24.540183 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Compute_service record updated for np0000003731:np0000003731 {{(pid=98967) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 26 10:34:24.540448 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 4.261s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:34:24.540584 np0000003731 nova-compute[98967]: DEBUG nova.service [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Creating RPC server for service: nova-compute on topic: compute {{(pid=98967) start /opt/stack/nova/nova/service.py:196}} Jun 26 10:34:24.557514 np0000003731 nova-compute[98967]: DEBUG nova.service [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Creating 2nd RPC server for service: nova-compute on topic: compute-alt {{(pid=98967) start /opt/stack/nova/nova/service.py:212}} Jun 26 10:34:24.572236 np0000003731 nova-compute[98967]: DEBUG nova.service [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] Join ServiceGroup membership for this service compute {{(pid=98967) start /opt/stack/nova/nova/service.py:222}} Jun 26 10:34:24.572432 np0000003731 nova-compute[98967]: DEBUG nova.servicegroup.drivers.db [None req-56052734-bac9-4c3c-a884-b2140e9ca4a3 None None] DB_Driver: join new ServiceGroup member np0000003731 to the compute group, service = {{(pid=98967) join /opt/stack/nova/nova/servicegroup/drivers/db.py:44}} Jun 26 10:34:30.075813 np0000003731 nova-compute[98967]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98967) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 26 10:35:22.574391 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:35:22.574907 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:35:22.575111 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:35:22.575358 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:35:22.575577 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:35:22.575788 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:35:22.576002 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._sync_power_states {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:35:23.079093 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:35:23.079093 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98967) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 26 10:35:23.079444 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager.update_available_resource {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:35:23.582885 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:35:23.583385 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:35:23.583385 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:35:23.583385 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Auditing locally available compute resources for np0000003731 (node: np0000003731) {{(pid=98967) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 26 10:35:23.592509 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:35:23.593457 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:35:23.607287 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "env LANG=C uptime" returned: 0 in 0.014s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:35:23.607805 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Hypervisor/Node resource view: name=np0000003731 free_ram=55264MB free_disk=74.93854904174805GB free_vcpus=16 pci_devices=[{"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98967) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 26 10:35:23.607985 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:35:23.608208 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:35:24.662153 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Total usable vcpus: 16, total allocated vcpus: 0 {{(pid=98967) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 26 10:35:24.662555 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Final resource view: name=np0000003731 phys_ram=64301MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 10:35:23 up 24 min, 2 users, load average: 1.76, 1.75, 1.00\n'} {{(pid=98967) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 26 10:35:24.710372 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:35:24.710581 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:35:25.213138 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:35:25.719093 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Compute_service record updated for np0000003731:np0000003731 {{(pid=98967) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 26 10:35:25.719561 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.111s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:35:25.719561 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._cleanup_running_deleted_instances {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:35:25.720656 np0000003731 nova-compute[98967]: DEBUG oslo.service.backend._threading.loopingcall [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 41.53 seconds {{(pid=98967) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 26 10:36:07.254526 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:36:07.255218 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:36:07.255610 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:36:07.255610 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:36:07.255931 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:36:07.256145 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:36:07.256339 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:36:07.256762 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:36:07.256762 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98967) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 26 10:36:07.257028 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager.update_available_resource {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:36:07.761891 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:07.761891 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:07.761891 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:36:07.761891 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Auditing locally available compute resources for np0000003731 (node: np0000003731) {{(pid=98967) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 26 10:36:07.783372 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:36:07.783372 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:36:07.804517 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "env LANG=C uptime" returned: 0 in 0.022s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:36:07.806679 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Hypervisor/Node resource view: name=np0000003731 free_ram=55410MB free_disk=74.86097717285156GB free_vcpus=16 pci_devices=[{"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98967) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 26 10:36:07.806679 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:07.806866 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:08.857073 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Total usable vcpus: 16, total allocated vcpus: 0 {{(pid=98967) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 26 10:36:08.857073 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Final resource view: name=np0000003731 phys_ram=64301MB used_ram=512MB phys_disk=95GB used_disk=0GB total_vcpus=16 used_vcpus=0 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 10:36:07 up 25 min, 2 users, load average: 1.37, 1.65, 1.00\n'} {{(pid=98967) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 26 10:36:08.898829 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:36:08.899075 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:36:09.401560 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:36:09.907363 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Compute_service record updated for np0000003731:np0000003731 {{(pid=98967) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 26 10:36:09.907852 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.102s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:36:09.907852 np0000003731 nova-compute[98967]: DEBUG oslo.service.backend._threading.loopingcall [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 60.00 seconds {{(pid=98967) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 26 10:36:30.078108 np0000003731 nova-compute[98967]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98967) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 26 10:36:39.658457 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Acquiring lock "d48c4183-618a-4abc-9d4c-956576c74490" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:39.658886 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "d48c4183-618a-4abc-9d4c-956576c74490" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:39.808862 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "81a0f65d-2017-4275-aabe-88bc8c81225d" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:39.809096 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:40.164283 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Starting instance... {{(pid=98967) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 26 10:36:40.315051 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Starting instance... {{(pid=98967) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 26 10:36:40.734370 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:40.734704 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:40.737585 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98967) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 26 10:36:40.737853 np0000003731 nova-compute[98967]: INFO nova.compute.claims [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Claim successful on node np0000003731 Jun 26 10:36:40.869637 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:41.928949 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:36:41.929377 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:36:42.432222 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:36:42.938806 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.204s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:36:42.939344 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Start building networks asynchronously for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 26 10:36:42.943437 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.074s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:42.947366 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98967) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 26 10:36:42.947495 np0000003731 nova-compute[98967]: INFO nova.compute.claims [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Claim successful on node np0000003731 Jun 26 10:36:43.450018 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Allocating IP information in the background. {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 26 10:36:43.450018 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] allocate_for_instance() {{(pid=98967) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 26 10:36:43.450941 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:36:43.451891 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:36:43.959382 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 26 10:36:44.077235 np0000003731 nova-compute[98967]: DEBUG nova.policy [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'a2ddca56c98d4cb59b505987f4d0f67c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'acf021cccf734aff828c39edc32e8b5e', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98967) authorize /opt/stack/nova/nova/policy.py:192}} Jun 26 10:36:44.168310 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:36:44.168310 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:36:44.464165 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Start building block device mappings for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 26 10:36:44.670878 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:36:44.742948 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Successfully created port: 354a4b12-1c99-40fe-9c24-5e9a8aa3293f {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:36:45.181179 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.238s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:36:45.181489 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Start building networks asynchronously for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 26 10:36:45.472788 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Start spawning the instance on the hypervisor. {{(pid=98967) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 26 10:36:45.474482 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Creating instance directory {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 26 10:36:45.474482 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Creating image(s) Jun 26 10:36:45.475373 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Acquiring lock "/opt/stack/data/nova/instances/d48c4183-618a-4abc-9d4c-956576c74490/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:45.475373 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "/opt/stack/data/nova/instances/d48c4183-618a-4abc-9d4c-956576c74490/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:45.476786 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "/opt/stack/data/nova/instances/d48c4183-618a-4abc-9d4c-956576c74490/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:36:45.477226 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Acquiring lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:45.478406 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:45.688486 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Allocating IP information in the background. {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 26 10:36:45.688708 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] allocate_for_instance() {{(pid=98967) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 26 10:36:45.689405 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:36:45.689644 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:36:45.778700 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Successfully updated port: 354a4b12-1c99-40fe-9c24-5e9a8aa3293f {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:36:45.825326 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:36:45.828273 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:36:45.828685 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe.part --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:36:45.894452 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe.part --force-share --output=json" returned: 0 in 0.065s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:36:45.895379 np0000003731 nova-compute[98967]: DEBUG nova.virt.images [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] a9b18127-6fee-4ed6-b364-a2d634ecb8b7 was qcow2, converting to raw {{(pid=98967) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 26 10:36:45.896024 np0000003731 nova-compute[98967]: DEBUG nova.privsep.utils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98967) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 26 10:36:45.896499 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe.part /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe.converted {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:36:46.064889 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe.part /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe.converted" returned: 0 in 0.168s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:36:46.073226 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe.converted --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:36:46.135550 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe.converted --force-share --output=json" returned: 0 in 0.065s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:36:46.136121 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 0.658s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:36:46.136622 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:36:46.141389 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:36:46.142810 np0000003731 nova-compute[98967]: INFO oslo.privsep.daemon [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'nova.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmptqkowm6_/privsep.sock'] Jun 26 10:36:46.158612 np0000003731 sudo[110469]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context nova.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmptqkowm6_/privsep.sock Jun 26 10:36:46.159395 np0000003731 sudo[110469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 10:36:46.188783 np0000003731 nova-compute[98967]: DEBUG nova.policy [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a7c139c060e4c998d31cf957835db61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39600b204ad64a6db28676693c86dd70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98967) authorize /opt/stack/nova/nova/policy.py:192}} Jun 26 10:36:46.197118 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 26 10:36:46.283799 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Acquiring lock "refresh_cache-d48c4183-618a-4abc-9d4c-956576c74490" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:36:46.283913 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Acquired lock "refresh_cache-d48c4183-618a-4abc-9d4c-956576c74490" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:36:46.284070 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:36:46.456256 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 26 10:36:46.456338 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 26 10:36:46.456378 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 26 10:36:46.456409 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: Jun 26 10:36:46.456437 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 26 10:36:46.457068 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 26 10:36:46.457068 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 26 10:36:46.457068 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: Jun 26 10:36:46.457068 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 26 10:36:46.504147 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-4d77c645-3ecf-4b36-aa1e-a1e6de7a9477 req-d4102c9a-4a90-4229-aaa3-d3f77b8bde89 service nova] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Received event network-changed-354a4b12-1c99-40fe-9c24-5e9a8aa3293f {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:36:46.504285 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-4d77c645-3ecf-4b36-aa1e-a1e6de7a9477 req-d4102c9a-4a90-4229-aaa3-d3f77b8bde89 service nova] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Refreshing instance network info cache due to event network-changed-354a4b12-1c99-40fe-9c24-5e9a8aa3293f. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:36:46.504432 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-4d77c645-3ecf-4b36-aa1e-a1e6de7a9477 req-d4102c9a-4a90-4229-aaa3-d3f77b8bde89 service nova] Acquiring lock "refresh_cache-d48c4183-618a-4abc-9d4c-956576c74490" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:36:46.704652 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Start building block device mappings for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 26 10:36:46.834087 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 26 10:36:46.834213 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 26 10:36:46.834213 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 26 10:36:46.834260 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: Jun 26 10:36:46.834343 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 26 10:36:46.834343 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 26 10:36:46.834422 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 26 10:36:46.834463 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: Jun 26 10:36:46.834501 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 26 10:36:46.876342 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:36:47.079687 np0000003731 sudo[110469]: pam_unix(sudo:session): session closed for user root Jun 26 10:36:47.081231 np0000003731 nova-compute[98967]: INFO oslo.privsep.daemon [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Spawned new privsep daemon via rootwrap Jun 26 10:36:47.082087 np0000003731 nova-compute[98967]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 26 10:36:47.082185 np0000003731 nova-compute[98967]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 26 10:36:47.082281 np0000003731 nova-compute[98967]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jun 26 10:36:47.082378 np0000003731 nova-compute[98967]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 110503 Jun 26 10:36:47.168245 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:36:47.233219 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.065s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:36:47.233783 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Acquiring lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:47.234251 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:47.234687 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:36:47.237695 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:36:47.237948 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:36:47.262236 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Successfully created port: b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:36:47.298281 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.060s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:36:47.298871 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/d48c4183-618a-4abc-9d4c-956576c74490/disk 1073741824 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:36:47.335109 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/d48c4183-618a-4abc-9d4c-956576c74490/disk 1073741824" returned: 0 in 0.036s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:36:47.335666 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.101s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:36:47.336324 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:36:47.412326 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:36:47.416839 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.080s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:36:47.417462 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Checking if we can resize image /opt/stack/data/nova/instances/d48c4183-618a-4abc-9d4c-956576c74490/disk. size=1073741824 {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 26 10:36:47.417931 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d48c4183-618a-4abc-9d4c-956576c74490/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:36:47.477491 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d48c4183-618a-4abc-9d4c-956576c74490/disk --force-share --output=json" returned: 0 in 0.059s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:36:47.478253 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Cannot resize image /opt/stack/data/nova/instances/d48c4183-618a-4abc-9d4c-956576c74490/disk to a smaller size. {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 26 10:36:47.478483 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Created local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 26 10:36:47.478664 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Ensure instance console log exists: /opt/stack/data/nova/instances/d48c4183-618a-4abc-9d4c-956576c74490/console.log {{(pid=98967) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 26 10:36:47.478931 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:47.479181 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:47.479310 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:36:47.718717 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Start spawning the instance on the hypervisor. {{(pid=98967) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 26 10:36:47.720286 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Creating instance directory {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 26 10:36:47.720536 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Creating image(s) Jun 26 10:36:47.721102 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "/opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:47.721311 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "/opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:47.722073 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "/opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:36:47.722451 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:36:47.725691 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:36:47.726834 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:36:47.798095 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.071s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:36:47.798645 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:47.799252 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:47.800345 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:36:47.803079 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:36:47.803464 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:36:47.849181 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Successfully updated port: b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:36:47.875494 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.072s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:36:47.876055 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d/disk 1073741824 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:36:47.904187 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d/disk 1073741824" returned: 0 in 0.028s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:36:47.904539 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.105s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:36:47.904830 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:36:47.976692 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.071s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:36:47.978293 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Checking if we can resize image /opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d/disk. size=1073741824 {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 26 10:36:47.978293 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:36:48.040543 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d/disk --force-share --output=json" returned: 0 in 0.062s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:36:48.041065 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Cannot resize image /opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d/disk to a smaller size. {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 26 10:36:48.041527 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Created local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 26 10:36:48.041773 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Ensure instance console log exists: /opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d/console.log {{(pid=98967) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 26 10:36:48.042174 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:48.042574 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:48.042775 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:36:48.176245 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Updating instance_info_cache with network_info: [{"id": "354a4b12-1c99-40fe-9c24-5e9a8aa3293f", "address": "fa:16:3e:43:69:d4", "network": {"id": "1d434908-4015-4955-84bf-12c024021b3c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-679956387-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "acf021cccf734aff828c39edc32e8b5e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap354a4b12-1c", "ovs_interfaceid": "354a4b12-1c99-40fe-9c24-5e9a8aa3293f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:36:48.354993 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "refresh_cache-81a0f65d-2017-4275-aabe-88bc8c81225d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:36:48.356179 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquired lock "refresh_cache-81a0f65d-2017-4275-aabe-88bc8c81225d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:36:48.356179 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:36:48.658416 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-c2af4619-af0b-431a-9ff8-7803867588ca req-b66d3bfd-b2e9-4a86-9412-15c937d23f58 service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Received event network-changed-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:36:48.658660 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-c2af4619-af0b-431a-9ff8-7803867588ca req-b66d3bfd-b2e9-4a86-9412-15c937d23f58 service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Refreshing instance network info cache due to event network-changed-b6ae095e-5da6-45dd-95bd-47cf007120c3. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:36:48.658877 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c2af4619-af0b-431a-9ff8-7803867588ca req-b66d3bfd-b2e9-4a86-9412-15c937d23f58 service nova] Acquiring lock "refresh_cache-81a0f65d-2017-4275-aabe-88bc8c81225d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:36:48.679830 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Releasing lock "refresh_cache-d48c4183-618a-4abc-9d4c-956576c74490" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:36:48.680277 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Instance network_info: |[{"id": "354a4b12-1c99-40fe-9c24-5e9a8aa3293f", "address": "fa:16:3e:43:69:d4", "network": {"id": "1d434908-4015-4955-84bf-12c024021b3c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-679956387-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "acf021cccf734aff828c39edc32e8b5e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap354a4b12-1c", "ovs_interfaceid": "354a4b12-1c99-40fe-9c24-5e9a8aa3293f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 26 10:36:48.680790 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-4d77c645-3ecf-4b36-aa1e-a1e6de7a9477 req-d4102c9a-4a90-4229-aaa3-d3f77b8bde89 service nova] Acquired lock "refresh_cache-d48c4183-618a-4abc-9d4c-956576c74490" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:36:48.680975 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-4d77c645-3ecf-4b36-aa1e-a1e6de7a9477 req-d4102c9a-4a90-4229-aaa3-d3f77b8bde89 service nova] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Refreshing network info cache for port 354a4b12-1c99-40fe-9c24-5e9a8aa3293f {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:36:48.683376 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Start _get_guest_xml network_info=[{"id": "354a4b12-1c99-40fe-9c24-5e9a8aa3293f", "address": "fa:16:3e:43:69:d4", "network": {"id": "1d434908-4015-4955-84bf-12c024021b3c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-679956387-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "acf021cccf734aff828c39edc32e8b5e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap354a4b12-1c", "ovs_interfaceid": "354a4b12-1c99-40fe-9c24-5e9a8aa3293f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'image_id': 'a9b18127-6fee-4ed6-b364-a2d634ecb8b7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:36:48.686308 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:36:48.688143 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='tempest-DeleteServersTestJSON-server-812016894', uuid='d48c4183-618a-4abc-9d4c-956576c74490'), owner=OwnerMeta(userid='a2ddca56c98d4cb59b505987f4d0f67c', username='tempest-DeleteServersTestJSON-897256898-project-member', projectid='acf021cccf734aff828c39edc32e8b5e', projectname='tempest-DeleteServersTestJSON-897256898'), image=ImageMeta(id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "354a4b12-1c99-40fe-9c24-5e9a8aa3293f", "address": "fa:16:3e:43:69:d4", "network": {"id": "1d434908-4015-4955-84bf-12c024021b3c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-679956387-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "acf021cccf734aff828c39edc32e8b5e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap354a4b12-1c", "ovs_interfaceid": "354a4b12-1c99-40fe-9c24-5e9a8aa3293f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470208.6874683) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:36:48.689839 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:36:48.690462 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:36:48.691168 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:36:48.691450 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:36:48.692775 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:36:48.693184 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:36:48.693408 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:36:48.693543 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:36:48.693735 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:36:48.693863 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:36:48.694077 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:36:48.694296 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:36:48.694444 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:36:48.694832 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:36:48.694974 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:36:48.695155 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:36:48.709542 np0000003731 nova-compute[98967]: DEBUG nova.privsep.utils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98967) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 26 10:36:48.711163 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:36:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-812016894',display_name='tempest-DeleteServersTestJSON-server-812016894',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-deleteserverstestjson-server-812016894',id=1,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='acf021cccf734aff828c39edc32e8b5e',ramdisk_id='',reservation_id='r-oxk0tdw6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-897256898',owner_user_name='tempest-DeleteServersTestJSON-897256898-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:36:45Z,user_data=None,user_id='a2ddca56c98d4cb59b505987f4d0f67c',uuid=d48c4183-618a-4abc-9d4c-956576c74490,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "354a4b12-1c99-40fe-9c24-5e9a8aa3293f", "address": "fa:16:3e:43:69:d4", "network": {"id": "1d434908-4015-4955-84bf-12c024021b3c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-679956387-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "acf021cccf734aff828c39edc32e8b5e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap354a4b12-1c", "ovs_interfaceid": "354a4b12-1c99-40fe-9c24-5e9a8aa3293f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:36:48.711636 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Converting VIF {"id": "354a4b12-1c99-40fe-9c24-5e9a8aa3293f", "address": "fa:16:3e:43:69:d4", "network": {"id": "1d434908-4015-4955-84bf-12c024021b3c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-679956387-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "acf021cccf734aff828c39edc32e8b5e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap354a4b12-1c", "ovs_interfaceid": "354a4b12-1c99-40fe-9c24-5e9a8aa3293f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:36:48.712299 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:69:d4,bridge_name='br-int',has_traffic_filtering=True,id=354a4b12-1c99-40fe-9c24-5e9a8aa3293f,network=Network(1d434908-4015-4955-84bf-12c024021b3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap354a4b12-1c') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:36:48.713276 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lazy-loading 'pci_devices' on Instance uuid d48c4183-618a-4abc-9d4c-956576c74490 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:36:48.940428 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:36:49.172989 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:36:49.185280 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-4d77c645-3ecf-4b36-aa1e-a1e6de7a9477 req-d4102c9a-4a90-4229-aaa3-d3f77b8bde89 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] End _get_guest_xml xml= Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: d48c4183-618a-4abc-9d4c-956576c74490 Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: instance-00000001 Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: 196608 Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: 1 Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: tempest-DeleteServersTestJSON-server-812016894 Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: 2026-06-26 10:36:48 Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: 192 Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: 1 Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: 0 Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: 0 Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: 1 Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: True Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: bare Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: 1 Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: 0 Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: virtio Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: tempest-DeleteServersTestJSON-897256898-project-member Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: tempest-DeleteServersTestJSON-897256898 Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: d48c4183-618a-4abc-9d4c-956576c74490 Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: d48c4183-618a-4abc-9d4c-956576c74490 Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: hvm Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: 128 Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: 1 Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: Jun 26 10:36:49.217717 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:36:49.219751 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Preparing to wait for external event network-vif-plugged-354a4b12-1c99-40fe-9c24-5e9a8aa3293f {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:36:49.219751 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Acquiring lock "d48c4183-618a-4abc-9d4c-956576c74490-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:49.219751 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "d48c4183-618a-4abc-9d4c-956576c74490-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:49.219751 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "d48c4183-618a-4abc-9d4c-956576c74490-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:36:49.219751 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:36:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-812016894',display_name='tempest-DeleteServersTestJSON-server-812016894',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-deleteserverstestjson-server-812016894',id=1,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='acf021cccf734aff828c39edc32e8b5e',ramdisk_id='',reservation_id='r-oxk0tdw6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-DeleteServersTestJSON-897256898',owner_user_name='tempest-DeleteServersTestJSON-897256898-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:36:45Z,user_data=None,user_id='a2ddca56c98d4cb59b505987f4d0f67c',uuid=d48c4183-618a-4abc-9d4c-956576c74490,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "354a4b12-1c99-40fe-9c24-5e9a8aa3293f", "address": "fa:16:3e:43:69:d4", "network": {"id": "1d434908-4015-4955-84bf-12c024021b3c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-679956387-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "acf021cccf734aff828c39edc32e8b5e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap354a4b12-1c", "ovs_interfaceid": "354a4b12-1c99-40fe-9c24-5e9a8aa3293f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:36:49.221580 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Converting VIF {"id": "354a4b12-1c99-40fe-9c24-5e9a8aa3293f", "address": "fa:16:3e:43:69:d4", "network": {"id": "1d434908-4015-4955-84bf-12c024021b3c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-679956387-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "acf021cccf734aff828c39edc32e8b5e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap354a4b12-1c", "ovs_interfaceid": "354a4b12-1c99-40fe-9c24-5e9a8aa3293f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:36:49.221580 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:69:d4,bridge_name='br-int',has_traffic_filtering=True,id=354a4b12-1c99-40fe-9c24-5e9a8aa3293f,network=Network(1d434908-4015-4955-84bf-12c024021b3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap354a4b12-1c') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:36:49.221580 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:69:d4,bridge_name='br-int',has_traffic_filtering=True,id=354a4b12-1c99-40fe-9c24-5e9a8aa3293f,network=Network(1d434908-4015-4955-84bf-12c024021b3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap354a4b12-1c') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:36:49.269940 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Created schema index Interface.name {{(pid=98967) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Jun 26 10:36:49.270163 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Created schema index Port.name {{(pid=98967) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Jun 26 10:36:49.270335 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Created schema index Bridge.name {{(pid=98967) autocreate_indices /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/__init__.py:106}} Jun 26 10:36:49.270794 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] tcp:127.0.0.1:6640: entering CONNECTING {{(pid=98967) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jun 26 10:36:49.270997 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [POLLOUT] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:49.271649 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] tcp:127.0.0.1:6640: entering ACTIVE {{(pid=98967) _transition /opt/stack/data/venv/lib/python3.12/site-packages/ovs/reconnect.py:519}} Jun 26 10:36:49.271716 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:49.273455 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:49.290917 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:49.317824 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:49.322042 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:36:49.323371 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:36:49.324499 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:49.324905 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e30cdaab-2a6f-5e21-ade2-ffd5e442f012', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:36:49.326419 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:49.326736 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:36:49.328638 np0000003731 nova-compute[98967]: INFO oslo.privsep.daemon [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'vif_plug_ovs.privsep.vif_plug', '--privsep_sock_path', '/tmp/tmpl01of7vl/privsep.sock'] Jun 26 10:36:49.336875 np0000003731 sudo[110566]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context vif_plug_ovs.privsep.vif_plug --privsep_sock_path /tmp/tmpl01of7vl/privsep.sock Jun 26 10:36:49.337565 np0000003731 sudo[110566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 10:36:49.380303 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Updating instance_info_cache with network_info: [{"id": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "address": "fa:16:3e:4c:ec:5e", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ae095e-5d", "ovs_interfaceid": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:36:49.621428 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 26 10:36:49.621428 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 26 10:36:49.621428 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 26 10:36:49.621428 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: Jun 26 10:36:49.621428 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 26 10:36:49.621428 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 26 10:36:49.621428 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 26 10:36:49.621428 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: Jun 26 10:36:49.621428 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 26 10:36:49.648643 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-4d77c645-3ecf-4b36-aa1e-a1e6de7a9477 req-d4102c9a-4a90-4229-aaa3-d3f77b8bde89 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:36:49.753258 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "d26dc4db-d71c-43b9-811a-d39b111be119" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:49.753419 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "d26dc4db-d71c-43b9-811a-d39b111be119" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:49.871199 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-4d77c645-3ecf-4b36-aa1e-a1e6de7a9477 req-d4102c9a-4a90-4229-aaa3-d3f77b8bde89 service nova] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Updated VIF entry in instance network info cache for port 354a4b12-1c99-40fe-9c24-5e9a8aa3293f. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:36:49.871484 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-4d77c645-3ecf-4b36-aa1e-a1e6de7a9477 req-d4102c9a-4a90-4229-aaa3-d3f77b8bde89 service nova] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Updating instance_info_cache with network_info: [{"id": "354a4b12-1c99-40fe-9c24-5e9a8aa3293f", "address": "fa:16:3e:43:69:d4", "network": {"id": "1d434908-4015-4955-84bf-12c024021b3c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-679956387-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "acf021cccf734aff828c39edc32e8b5e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap354a4b12-1c", "ovs_interfaceid": "354a4b12-1c99-40fe-9c24-5e9a8aa3293f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:36:49.883125 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Releasing lock "refresh_cache-81a0f65d-2017-4275-aabe-88bc8c81225d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:36:49.883366 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Instance network_info: |[{"id": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "address": "fa:16:3e:4c:ec:5e", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ae095e-5d", "ovs_interfaceid": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 26 10:36:49.883672 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c2af4619-af0b-431a-9ff8-7803867588ca req-b66d3bfd-b2e9-4a86-9412-15c937d23f58 service nova] Acquired lock "refresh_cache-81a0f65d-2017-4275-aabe-88bc8c81225d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:36:49.884056 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-c2af4619-af0b-431a-9ff8-7803867588ca req-b66d3bfd-b2e9-4a86-9412-15c937d23f58 service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Refreshing network info cache for port b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:36:49.886212 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Start _get_guest_xml network_info=[{"id": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "address": "fa:16:3e:4c:ec:5e", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ae095e-5d", "ovs_interfaceid": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'image_id': 'a9b18127-6fee-4ed6-b364-a2d634ecb8b7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:36:49.890479 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:36:49.891660 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-674212499', uuid='81a0f65d-2017-4275-aabe-88bc8c81225d'), owner=OwnerMeta(userid='2a7c139c060e4c998d31cf957835db61', username='tempest-AttachVolumeShelveTestJSON-959960600-project-member', projectid='39600b204ad64a6db28676693c86dd70', projectname='tempest-AttachVolumeShelveTestJSON-959960600'), image=ImageMeta(id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "address": "fa:16:3e:4c:ec:5e", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ae095e-5d", "ovs_interfaceid": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470209.8913352) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:36:49.894137 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:36:49.894137 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:36:49.894705 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:36:49.894947 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:36:49.896020 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:36:49.896404 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:36:49.896594 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:36:49.896734 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:36:49.896922 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:36:49.897084 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:36:49.897227 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:36:49.897423 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:36:49.897575 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:36:49.897693 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:36:49.897931 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:36:49.898130 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:36:49.918802 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-674212499',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-attachvolumeshelvetestjson-server-674212499',id=2,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgeE4mXMKcSbJIWHFgR/TXryRGqygdB9I0LofQr9Tkzp2atTItlVxi0dphSY3RtGlhO4PbYXX3eB89/U6r4md80N0ifQ7kIfDklEzYBE4Yx9SRGtqxnbv5XSO42PKS1ng==',key_name='tempest-keypair-313994434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39600b204ad64a6db28676693c86dd70',ramdisk_id='',reservation_id='r-691lr44p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-959960600',owner_user_name='tempest-AttachVolumeShelveTestJSON-959960600-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:36:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a7c139c060e4c998d31cf957835db61',uuid=81a0f65d-2017-4275-aabe-88bc8c81225d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "address": "fa:16:3e:4c:ec:5e", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ae095e-5d", "ovs_interfaceid": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:36:49.919736 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Converting VIF {"id": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "address": "fa:16:3e:4c:ec:5e", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ae095e-5d", "ovs_interfaceid": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:36:49.920394 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:ec:5e,bridge_name='br-int',has_traffic_filtering=True,id=b6ae095e-5da6-45dd-95bd-47cf007120c3,network=Network(79bcd519-98c3-4905-a83f-c080654f2cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6ae095e-5d') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:36:49.922411 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lazy-loading 'pci_devices' on Instance uuid 81a0f65d-2017-4275-aabe-88bc8c81225d {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:36:50.009595 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 26 10:36:50.009658 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 26 10:36:50.009686 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 26 10:36:50.009727 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: Jun 26 10:36:50.009789 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 26 10:36:50.009869 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 26 10:36:50.009915 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 26 10:36:50.009949 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: Jun 26 10:36:50.010020 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 26 10:36:50.256060 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Starting instance... {{(pid=98967) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 26 10:36:50.282518 np0000003731 sudo[110566]: pam_unix(sudo:session): session closed for user root Jun 26 10:36:50.284663 np0000003731 nova-compute[98967]: INFO oslo.privsep.daemon [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Spawned new privsep daemon via rootwrap Jun 26 10:36:50.285747 np0000003731 nova-compute[98967]: INFO oslo.privsep.daemon [-] privsep daemon starting Jun 26 10:36:50.285942 np0000003731 nova-compute[98967]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jun 26 10:36:50.285942 np0000003731 nova-compute[98967]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_DAC_OVERRIDE|CAP_NET_ADMIN/CAP_DAC_OVERRIDE|CAP_NET_ADMIN/none Jun 26 10:36:50.286082 np0000003731 nova-compute[98967]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 110605 Jun 26 10:36:50.373588 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-4d77c645-3ecf-4b36-aa1e-a1e6de7a9477 req-d4102c9a-4a90-4229-aaa3-d3f77b8bde89 service nova] Releasing lock "refresh_cache-d48c4183-618a-4abc-9d4c-956576c74490" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:36:50.388102 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-c2af4619-af0b-431a-9ff8-7803867588ca req-b66d3bfd-b2e9-4a86-9412-15c937d23f58 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] End _get_guest_xml xml= Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: 81a0f65d-2017-4275-aabe-88bc8c81225d Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: instance-00000002 Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: 196608 Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: 1 Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: tempest-AttachVolumeShelveTestJSON-server-674212499 Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: 2026-06-26 10:36:49 Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: 192 Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: 1 Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: 0 Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: 0 Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: 1 Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: True Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: bare Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: 1 Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: 0 Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: virtio Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: tempest-AttachVolumeShelveTestJSON-959960600-project-member Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: tempest-AttachVolumeShelveTestJSON-959960600 Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: 81a0f65d-2017-4275-aabe-88bc8c81225d Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: 81a0f65d-2017-4275-aabe-88bc8c81225d Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: hvm Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: 128 Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: 1 Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: Jun 26 10:36:50.425584 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:36:50.427398 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Preparing to wait for external event network-vif-plugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:36:50.427398 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:50.427398 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:50.427398 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:36:50.429188 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-674212499',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-attachvolumeshelvetestjson-server-674212499',id=2,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgeE4mXMKcSbJIWHFgR/TXryRGqygdB9I0LofQr9Tkzp2atTItlVxi0dphSY3RtGlhO4PbYXX3eB89/U6r4md80N0ifQ7kIfDklEzYBE4Yx9SRGtqxnbv5XSO42PKS1ng==',key_name='tempest-keypair-313994434',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39600b204ad64a6db28676693c86dd70',ramdisk_id='',reservation_id='r-691lr44p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-959960600',owner_user_name='tempest-AttachVolumeShelveTestJSON-959960600-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:36:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a7c139c060e4c998d31cf957835db61',uuid=81a0f65d-2017-4275-aabe-88bc8c81225d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "address": "fa:16:3e:4c:ec:5e", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ae095e-5d", "ovs_interfaceid": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:36:50.430381 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Converting VIF {"id": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "address": "fa:16:3e:4c:ec:5e", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ae095e-5d", "ovs_interfaceid": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:36:50.431797 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:ec:5e,bridge_name='br-int',has_traffic_filtering=True,id=b6ae095e-5da6-45dd-95bd-47cf007120c3,network=Network(79bcd519-98c3-4905-a83f-c080654f2cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6ae095e-5d') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:36:50.431797 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:ec:5e,bridge_name='br-int',has_traffic_filtering=True,id=b6ae095e-5da6-45dd-95bd-47cf007120c3,network=Network(79bcd519-98c3-4905-a83f-c080654f2cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6ae095e-5d') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:36:50.432403 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:50.432609 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:36:50.432729 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:36:50.433347 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:50.433511 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6dd0ced6-2975-5adc-8e02-38dd350350b7', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:36:50.434369 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:50.434963 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:36:50.435953 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:50.591812 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:50.592105 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6ae095e-5d, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:36:50.592463 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb6ae095e-5d, col_values=(('qos', UUID('7101acba-caf4-4ad5-aef9-fdaa16fff76e')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:36:50.593772 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb6ae095e-5d, col_values=(('external_ids', {'iface-id': 'b6ae095e-5da6-45dd-95bd-47cf007120c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:ec:5e', 'vm-uuid': '81a0f65d-2017-4275-aabe-88bc8c81225d'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:36:50.594856 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:50.596592 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:36:50.605095 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:50.605623 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:50.605824 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap354a4b12-1c, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:36:50.606208 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap354a4b12-1c, col_values=(('qos', UUID('c4a01483-d910-4239-86ec-bd3d9c52be04')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:36:50.606357 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap354a4b12-1c, col_values=(('external_ids', {'iface-id': '354a4b12-1c99-40fe-9c24-5e9a8aa3293f', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:69:d4', 'vm-uuid': 'd48c4183-618a-4abc-9d4c-956576c74490'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:36:50.607597 np0000003731 nova-compute[98967]: INFO os_vif [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:ec:5e,bridge_name='br-int',has_traffic_filtering=True,id=b6ae095e-5da6-45dd-95bd-47cf007120c3,network=Network(79bcd519-98c3-4905-a83f-c080654f2cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6ae095e-5d') Jun 26 10:36:50.609053 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:36:50.620734 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:50.622771 np0000003731 nova-compute[98967]: INFO os_vif [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:69:d4,bridge_name='br-int',has_traffic_filtering=True,id=354a4b12-1c99-40fe-9c24-5e9a8aa3293f,network=Network(1d434908-4015-4955-84bf-12c024021b3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap354a4b12-1c') Jun 26 10:36:50.681640 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Acquiring lock "c43215aa-be15-4556-8162-bcd9793048c0" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:50.681854 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "c43215aa-be15-4556-8162-bcd9793048c0" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:50.789184 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-c2af4619-af0b-431a-9ff8-7803867588ca req-b66d3bfd-b2e9-4a86-9412-15c937d23f58 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:36:50.825119 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:50.825348 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:50.830869 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98967) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 26 10:36:50.831064 np0000003731 nova-compute[98967]: INFO nova.compute.claims [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Claim successful on node np0000003731 Jun 26 10:36:50.932579 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-c2af4619-af0b-431a-9ff8-7803867588ca req-b66d3bfd-b2e9-4a86-9412-15c937d23f58 service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Updated VIF entry in instance network info cache for port b6ae095e-5da6-45dd-95bd-47cf007120c3. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:36:50.933227 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-c2af4619-af0b-431a-9ff8-7803867588ca req-b66d3bfd-b2e9-4a86-9412-15c937d23f58 service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Updating instance_info_cache with network_info: [{"id": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "address": "fa:16:3e:4c:ec:5e", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ae095e-5d", "ovs_interfaceid": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:36:51.183871 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Starting instance... {{(pid=98967) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 26 10:36:51.394823 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:51.395218 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:51.435299 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c2af4619-af0b-431a-9ff8-7803867588ca req-b66d3bfd-b2e9-4a86-9412-15c937d23f58 service nova] Releasing lock "refresh_cache-81a0f65d-2017-4275-aabe-88bc8c81225d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:36:51.448149 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "64a636b4-e106-4968-8740-9938e9b2bcc8" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:51.451992 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "64a636b4-e106-4968-8740-9938e9b2bcc8" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:51.755398 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:51.897429 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Starting instance... {{(pid=98967) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 26 10:36:51.951266 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Starting instance... {{(pid=98967) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 26 10:36:52.127696 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:36:52.127696 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:36:52.127696 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] No VIF found with MAC fa:16:3e:4c:ec:5e, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:36:52.128053 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Using config drive Jun 26 10:36:52.143239 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:36:52.143384 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:36:52.143437 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] No VIF found with MAC fa:16:3e:43:69:d4, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:36:52.143865 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Using config drive Jun 26 10:36:52.210213 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:36:52.210453 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:36:52.333398 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:52.414719 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:52.462492 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:52.518453 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:52.634115 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:36:52.651239 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:36:52.713088 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:36:53.168784 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Creating config drive at /opt/stack/data/nova/instances/d48c4183-618a-4abc-9d4c-956576c74490/disk.config Jun 26 10:36:53.172681 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d48c4183-618a-4abc-9d4c-956576c74490/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpanvt8css {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:36:53.199060 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d48c4183-618a-4abc-9d4c-956576c74490/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpanvt8css" returned: 0 in 0.026s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:36:53.223117 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.398s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:36:53.223961 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.468s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:53.224234 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Start building networks asynchronously for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 26 10:36:53.242028 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98967) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 26 10:36:53.242028 np0000003731 nova-compute[98967]: INFO nova.compute.claims [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Claim successful on node np0000003731 Jun 26 10:36:53.525500 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Creating config drive at /opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d/disk.config Jun 26 10:36:53.529199 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_gb4an02 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:36:53.568661 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp_gb4an02" returned: 0 in 0.039s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:36:53.694748 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:53.719895 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:53.733504 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Allocating IP information in the background. {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 26 10:36:53.733730 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] allocate_for_instance() {{(pid=98967) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 26 10:36:53.734205 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:36:53.734491 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:36:53.893712 np0000003731 nova-compute[98967]: DEBUG nova.policy [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8a8a0b0240a34fb0bcf62ee7ec259cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2798faed447838b6c87f6d15cce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98967) authorize /opt/stack/nova/nova/policy.py:192}} Jun 26 10:36:53.909952 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:53.926142 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:54.238673 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 26 10:36:54.244965 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:54.276244 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:54.280572 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:54.365958 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:54.645955 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:36:54.646430 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:36:54.746115 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Start building block device mappings for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 26 10:36:54.896387 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Successfully created port: 7d9b0e94-555b-490b-a3bc-898d6821b394 {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:36:55.066474 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Acquiring lock "5bc6474f-1a05-4e8a-9553-a5597c60728d" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:55.066760 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Lock "5bc6474f-1a05-4e8a-9553-a5597c60728d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:55.151637 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:36:55.246580 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [-] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:36:55.246910 np0000003731 nova-compute[98967]: INFO nova.compute.manager [-] [instance: d48c4183-618a-4abc-9d4c-956576c74490] VM Started (Lifecycle Event) Jun 26 10:36:55.251336 np0000003731 nova-compute[98967]: INFO nova.virt.block_device [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Booting with volume 231967fc-b56e-42ba-83e3-550c9b1adce0 at /dev/vda Jun 26 10:36:55.353596 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.79', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003731', 'execute': None}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:36:55.354413 np0000003731 nova-compute[98967]: INFO oslo.privsep.daemon [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running privsep helper: ['sudo', 'nova-rootwrap', '/etc/nova/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/nova/nova-cpu.conf', '--privsep_context', 'os_brick.privileged.default', '--privsep_sock_path', '/tmp/tmpns78s5lk/privsep.sock'] Jun 26 10:36:55.363949 np0000003731 sudo[110794]: stack : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/nova-rootwrap /etc/nova/rootwrap.conf privsep-helper --config-file /etc/nova/nova-cpu.conf --privsep_context os_brick.privileged.default --privsep_sock_path /tmp/tmpns78s5lk/privsep.sock Jun 26 10:36:55.364827 np0000003731 sudo[110794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1002) Jun 26 10:36:55.560621 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Successfully updated port: 7d9b0e94-555b-490b-a3bc-898d6821b394 {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:36:55.568762 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Starting instance... {{(pid=98967) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 26 10:36:55.613330 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:55.649978 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jun 26 10:36:55.650388 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 26 10:36:55.650388 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 26 10:36:55.650388 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: Jun 26 10:36:55.650388 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 26 10:36:55.650571 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 26 10:36:55.650743 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 26 10:36:55.652081 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: Jun 26 10:36:55.652081 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jun 26 10:36:55.660450 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.437s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:36:55.664142 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 3.198s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:55.664594 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Start building networks asynchronously for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 26 10:36:55.669950 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98967) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 26 10:36:55.670218 np0000003731 nova-compute[98967]: INFO nova.compute.claims [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Claim successful on node np0000003731 Jun 26 10:36:55.680374 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-d99edfce-74e8-46be-851e-844df43e7fb5 req-590dab8e-8318-4e29-b096-5555a1744f54 service nova] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Received event network-changed-7d9b0e94-555b-490b-a3bc-898d6821b394 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:36:55.680837 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-d99edfce-74e8-46be-851e-844df43e7fb5 req-590dab8e-8318-4e29-b096-5555a1744f54 service nova] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Refreshing instance network info cache due to event network-changed-7d9b0e94-555b-490b-a3bc-898d6821b394. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:36:55.681058 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-d99edfce-74e8-46be-851e-844df43e7fb5 req-590dab8e-8318-4e29-b096-5555a1744f54 service nova] Acquiring lock "refresh_cache-d26dc4db-d71c-43b9-811a-d39b111be119" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:36:55.681135 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-d99edfce-74e8-46be-851e-844df43e7fb5 req-590dab8e-8318-4e29-b096-5555a1744f54 service nova] Acquired lock "refresh_cache-d26dc4db-d71c-43b9-811a-d39b111be119" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:36:55.681297 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-d99edfce-74e8-46be-851e-844df43e7fb5 req-590dab8e-8318-4e29-b096-5555a1744f54 service nova] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Refreshing network info cache for port 7d9b0e94-555b-490b-a3bc-898d6821b394 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:36:55.749233 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:36:55.752186 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Paused> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:36:55.752356 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: d48c4183-618a-4abc-9d4c-956576c74490] VM Paused (Lifecycle Event) Jun 26 10:36:55.961633 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jun 26 10:36:55.961815 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jun 26 10:36:55.961815 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jun 26 10:36:55.961943 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: Jun 26 10:36:55.962129 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jun 26 10:36:55.962129 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jun 26 10:36:55.962219 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jun 26 10:36:55.962287 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: Jun 26 10:36:55.962366 np0000003731 nova-compute[98967]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jun 26 10:36:56.065544 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "refresh_cache-d26dc4db-d71c-43b9-811a-d39b111be119" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:36:56.067650 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-2917d313-580c-4290-bba6-13cc506d7ea1 req-65b9c340-3a9c-4fe2-8cad-13483cbccc7c service nova] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Received event network-vif-unplugged-354a4b12-1c99-40fe-9c24-5e9a8aa3293f {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:36:56.067874 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-2917d313-580c-4290-bba6-13cc506d7ea1 req-65b9c340-3a9c-4fe2-8cad-13483cbccc7c service nova] Acquiring lock "d48c4183-618a-4abc-9d4c-956576c74490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:56.068055 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-2917d313-580c-4290-bba6-13cc506d7ea1 req-65b9c340-3a9c-4fe2-8cad-13483cbccc7c service nova] Lock "d48c4183-618a-4abc-9d4c-956576c74490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:56.068254 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-2917d313-580c-4290-bba6-13cc506d7ea1 req-65b9c340-3a9c-4fe2-8cad-13483cbccc7c service nova] Lock "d48c4183-618a-4abc-9d4c-956576c74490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:36:56.068418 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-2917d313-580c-4290-bba6-13cc506d7ea1 req-65b9c340-3a9c-4fe2-8cad-13483cbccc7c service nova] [instance: d48c4183-618a-4abc-9d4c-956576c74490] No event matching network-vif-unplugged-354a4b12-1c99-40fe-9c24-5e9a8aa3293f in dict_keys([('network-vif-plugged', '354a4b12-1c99-40fe-9c24-5e9a8aa3293f')]) {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 26 10:36:56.068586 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-2917d313-580c-4290-bba6-13cc506d7ea1 req-65b9c340-3a9c-4fe2-8cad-13483cbccc7c service nova] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Received unexpected event network-vif-unplugged-354a4b12-1c99-40fe-9c24-5e9a8aa3293f for instance with vm_state building and task_state spawning. Jun 26 10:36:56.136900 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:56.174411 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Allocating IP information in the background. {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 26 10:36:56.174744 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] allocate_for_instance() {{(pid=98967) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 26 10:36:56.174744 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:36:56.175021 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:36:56.183949 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-d99edfce-74e8-46be-851e-844df43e7fb5 req-590dab8e-8318-4e29-b096-5555a1744f54 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:36:56.226125 np0000003731 nova-compute[98967]: INFO oslo.privsep.daemon [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Spawned new privsep daemon via rootwrap Jun 26 10:36:56.224231 np0000003731 sudo[110794]: pam_unix(sudo:session): session closed for user root Jun 26 10:36:56.256169 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:36:56.259330 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:36:56.270582 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:56.327647 np0000003731 nova-compute[98967]: DEBUG nova.policy [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'c121ca0bdcf24093be4959e77345c328', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f37c91742d834881a1ec62e1eb1ecdcf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98967) authorize /opt/stack/nova/nova/policy.py:192}} Jun 26 10:36:56.364733 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.scaleio [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98967) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 10:36:56.365129 np0000003731 nova-compute[98967]: WARNING os_brick.initiator.connectors.nvmeof [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Could not find nvme_core/parameters/multipath: FileNotFoundError: [Errno 2] No such file or directory: '/sys/module/nvme_core/parameters/multipath' Jun 26 10:36:56.392852 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): nvme version {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:36:56.412569 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-d99edfce-74e8-46be-851e-844df43e7fb5 req-590dab8e-8318-4e29-b096-5555a1744f54 service nova] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:36:56.421982 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] 'nvme version' failed. Not Retrying. {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 10:36:56.422368 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] nvme not present on system {{(pid=98967) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 10:36:56.441826 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98967) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 10:36:56.442405 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.lightos [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Current host hostNQN and IP(s) are ['10.4.3.79', 'fe80::f816:3eff:fe55:ba34', '192.168.40.6', 'fe80::f816:3eff:fe6b:fe1a', '192.168.50.6', 'fe80::f816:3eff:feca:9cd0', '192.168.10.6', 'fe80::f816:3eff:feb4:4e78', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f8bb:38ff:fe28:ff4a', 'fe80::fc16:3eff:fe43:69d4', 'fe80::fc16:3eff:fe4c:ec5e'] Jun 26 10:36:56.442687 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 10:36:56.442870 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] LIGHTOS: no hostnqn found. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 10:36:56.443839 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] <== get_connector_properties: return (1089ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.79', 'host': 'np0000003731', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:2fddcc2116d6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '7f2a0776-2f14-4357-a22e-baa6677eb22e', 'nvme_native_multipath': False} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:36:56.444104 np0000003731 nova-compute[98967]: DEBUG nova.virt.block_device [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Updating existing volume attachment record: 896b2900-f25f-47f9-8b50-099226a4a971 {{(pid=98967) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 26 10:36:56.627317 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-d99edfce-74e8-46be-851e-844df43e7fb5 req-590dab8e-8318-4e29-b096-5555a1744f54 service nova] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:36:56.675049 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Ignoring supplied device name: /dev/sda. Libvirt can't honour user-supplied dev names Jun 26 10:36:56.728313 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:56.731882 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:56.733951 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:56.750038 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:56.763291 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: d48c4183-618a-4abc-9d4c-956576c74490] During sync_power_state the instance has a pending task (spawning). Skip. Jun 26 10:36:56.763730 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:36:56.763897 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] VM Started (Lifecycle Event) Jun 26 10:36:57.007094 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Successfully created port: 85e3464e-eadb-4a6d-b3b5-073945346160 {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:36:57.129688 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-d99edfce-74e8-46be-851e-844df43e7fb5 req-590dab8e-8318-4e29-b096-5555a1744f54 service nova] Releasing lock "refresh_cache-d26dc4db-d71c-43b9-811a-d39b111be119" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:36:57.130904 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquired lock "refresh_cache-d26dc4db-d71c-43b9-811a-d39b111be119" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:36:57.131138 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:36:57.164684 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:36:57.164874 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:36:57.178781 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Start building block device mappings for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 26 10:36:57.266717 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:36:57.268784 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Paused> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:36:57.268949 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] VM Paused (Lifecycle Event) Jun 26 10:36:57.344660 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:57.469292 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:57.470464 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:57.475967 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:57.490550 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:36:57.622477 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Successfully updated port: 85e3464e-eadb-4a6d-b3b5-073945346160 {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:36:57.668032 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:36:57.709694 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:36:57.771925 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:36:57.773213 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:36:57.889130 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:36:58.031017 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Updating instance_info_cache with network_info: [{"id": "7d9b0e94-555b-490b-a3bc-898d6821b394", "address": "fa:16:3e:37:b3:f6", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9b0e94-55", "ovs_interfaceid": "7d9b0e94-555b-490b-a3bc-898d6821b394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:36:58.124366 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Acquiring lock "refresh_cache-c43215aa-be15-4556-8162-bcd9793048c0" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:36:58.124468 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Acquired lock "refresh_cache-c43215aa-be15-4556-8162-bcd9793048c0" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:36:58.124625 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:36:58.146589 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Received event network-vif-unplugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:36:58.146885 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] Acquiring lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:58.147307 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:58.147510 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:36:58.147766 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] No event matching network-vif-unplugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 in dict_keys([('network-vif-plugged', 'b6ae095e-5da6-45dd-95bd-47cf007120c3')]) {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 26 10:36:58.147923 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Received unexpected event network-vif-unplugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 for instance with vm_state building and task_state spawning. Jun 26 10:36:58.148261 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Received event network-vif-plugged-354a4b12-1c99-40fe-9c24-5e9a8aa3293f {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:36:58.148443 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] Acquiring lock "d48c4183-618a-4abc-9d4c-956576c74490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:58.148660 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] Lock "d48c4183-618a-4abc-9d4c-956576c74490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:58.148823 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] Lock "d48c4183-618a-4abc-9d4c-956576c74490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:36:58.148978 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Processing event network-vif-plugged-354a4b12-1c99-40fe-9c24-5e9a8aa3293f {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:36:58.149207 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Received event network-vif-plugged-354a4b12-1c99-40fe-9c24-5e9a8aa3293f {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:36:58.150476 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:36:58.150665 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] Acquiring lock "d48c4183-618a-4abc-9d4c-956576c74490-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:58.150807 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] Lock "d48c4183-618a-4abc-9d4c-956576c74490-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:58.150933 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] Lock "d48c4183-618a-4abc-9d4c-956576c74490-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:36:58.151073 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] [instance: d48c4183-618a-4abc-9d4c-956576c74490] No waiting events found dispatching network-vif-plugged-354a4b12-1c99-40fe-9c24-5e9a8aa3293f {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:36:58.151178 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Received unexpected event network-vif-plugged-354a4b12-1c99-40fe-9c24-5e9a8aa3293f for instance with vm_state building and task_state spawning. Jun 26 10:36:58.151282 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Received event network-vif-plugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:36:58.151403 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] Acquiring lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:58.151619 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:58.151721 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:36:58.151821 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Processing event network-vif-plugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:36:58.151950 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Received event network-vif-plugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:36:58.152115 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] Acquiring lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:58.152235 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:58.152412 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:36:58.152563 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] No waiting events found dispatching network-vif-plugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:36:58.152698 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Received unexpected event network-vif-plugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 for instance with vm_state building and task_state spawning. Jun 26 10:36:58.153113 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Received event network-changed-85e3464e-eadb-4a6d-b3b5-073945346160 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:36:58.153207 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Refreshing instance network info cache due to event network-changed-85e3464e-eadb-4a6d-b3b5-073945346160. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:36:58.153312 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] Acquiring lock "refresh_cache-c43215aa-be15-4556-8162-bcd9793048c0" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:36:58.153770 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Instance event wait completed in 2 seconds for network-vif-plugged {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:36:58.154452 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Guest created on hypervisor {{(pid=98967) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 26 10:36:58.155856 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Guest created on hypervisor {{(pid=98967) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 26 10:36:58.156264 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Instance spawned successfully. Jun 26 10:36:58.156693 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 26 10:36:58.159341 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Instance spawned successfully. Jun 26 10:36:58.160053 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 26 10:36:58.175386 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.515s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:36:58.175880 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Start building networks asynchronously for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 26 10:36:58.179568 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 5.666s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:58.182908 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98967) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 26 10:36:58.183123 np0000003731 nova-compute[98967]: INFO nova.compute.claims [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Claim successful on node np0000003731 Jun 26 10:36:58.187939 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Start spawning the instance on the hypervisor. {{(pid=98967) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 26 10:36:58.189250 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Creating instance directory {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 26 10:36:58.190438 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Creating image(s) Jun 26 10:36:58.192118 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Acquiring lock "/opt/stack/data/nova/instances/c43215aa-be15-4556-8162-bcd9793048c0/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:58.192358 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "/opt/stack/data/nova/instances/c43215aa-be15-4556-8162-bcd9793048c0/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:58.193151 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "/opt/stack/data/nova/instances/c43215aa-be15-4556-8162-bcd9793048c0/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:36:58.193616 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Acquiring lock "b22edf7fe39f6aefea5a3e90a11c470f2176d698" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:58.194243 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "b22edf7fe39f6aefea5a3e90a11c470f2176d698" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:58.276605 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] During sync_power_state the instance has a pending task (spawning). Skip. Jun 26 10:36:58.277117 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:36:58.277215 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: d48c4183-618a-4abc-9d4c-956576c74490] VM Resumed (Lifecycle Event) Jun 26 10:36:58.533214 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Releasing lock "refresh_cache-d26dc4db-d71c-43b9-811a-d39b111be119" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:36:58.533459 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Instance network_info: |[{"id": "7d9b0e94-555b-490b-a3bc-898d6821b394", "address": "fa:16:3e:37:b3:f6", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9b0e94-55", "ovs_interfaceid": "7d9b0e94-555b-490b-a3bc-898d6821b394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 26 10:36:58.609199 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Start spawning the instance on the hypervisor. {{(pid=98967) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 26 10:36:58.610244 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Creating instance directory {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 26 10:36:58.610491 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Creating image(s) Jun 26 10:36:58.610748 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Did not create local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 26 10:36:58.610902 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Ensure instance console log exists: /opt/stack/data/nova/instances/d26dc4db-d71c-43b9-811a-d39b111be119/console.log {{(pid=98967) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 26 10:36:58.611225 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:58.611414 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:58.611606 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:36:58.612065 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Start _get_guest_xml network_info=[{"id": "7d9b0e94-555b-490b-a3bc-898d6821b394", "address": "fa:16:3e:37:b3:f6", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9b0e94-55", "ovs_interfaceid": "7d9b0e94-555b-490b-a3bc-898d6821b394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '231967fc-b56e-42ba-83e3-550c9b1adce0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'd26dc4db-d71c-43b9-811a-d39b111be119', 'attached_at': '', 'detached_at': '', 'volume_id': '231967fc-b56e-42ba-83e3-550c9b1adce0', 'serial': '231967fc-b56e-42ba-83e3-550c9b1adce0', 'multiattach': True}, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '896b2900-f25f-47f9-8b50-099226a4a971', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:36:58.616674 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:36:58.617879 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeMultiAttachTest-server-923442882', uuid='d26dc4db-d71c-43b9-811a-d39b111be119'), owner=OwnerMeta(userid='8a8a0b0240a34fb0bcf62ee7ec259cb2', username='tempest-AttachVolumeMultiAttachTest-1668992443-project-member', projectid='49c2798faed447838b6c87f6d15cce66', projectname='tempest-AttachVolumeMultiAttachTest-1668992443'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7d9b0e94-555b-490b-a3bc-898d6821b394", "address": "fa:16:3e:37:b3:f6", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9b0e94-55", "ovs_interfaceid": "7d9b0e94-555b-490b-a3bc-898d6821b394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470218.6174858) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:36:58.618714 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:36:58.619052 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:36:58.619772 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:36:58.619952 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:36:58.620816 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:36:58.621080 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:36:58.622940 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:36:58.622940 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:36:58.622940 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:36:58.622940 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:36:58.622940 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:36:58.622940 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:36:58.622940 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:36:58.622940 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:36:58.622940 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:36:58.622940 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:36:58.634139 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "cache_volume_driver" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.._cache_volume_driver" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:58.634313 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "cache_volume_driver" acquired by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.._cache_volume_driver" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:58.636386 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connector [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Factory for ISCSI on None {{(pid=98967) factory /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connector.py:243}} Jun 26 10:36:58.636709 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "cache_volume_driver" "released" by "nova.virt.libvirt.driver.LibvirtDriver._get_volume_driver.._cache_volume_driver" :: held 0.002s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:36:58.636764 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Calling os-brick to attach iSCSI Volume {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 26 10:36:58.637107 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '231967fc-b56e-42ba-83e3-550c9b1adce0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:36:58.637321 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:36:58.637617 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:36:58.638306 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '231967fc-b56e-42ba-83e3-550c9b1adce0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 10:36:58.652251 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:36:58.653370 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:36:58.654638 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:36:58.654870 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:36:58.655252 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:36:58.655912 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:36:58.665169 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Found default for hw_cdrom_bus of ide {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:36:58.665303 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Found default for hw_disk_bus of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:36:58.665967 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Found default for hw_input_bus of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:36:58.665967 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Found default for hw_pointer_model of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:36:58.666137 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Found default for hw_video_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:36:58.666684 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Found default for hw_vif_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:36:58.669830 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Found default for hw_cdrom_bus of ide {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:36:58.669985 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Found default for hw_disk_bus of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:36:58.670882 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Found default for hw_input_bus of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:36:58.670882 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Found default for hw_pointer_model of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:36:58.671019 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Found default for hw_video_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:36:58.671212 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Found default for hw_vif_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:36:58.676923 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:36:58.676923 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:36:58.679391 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:36:58.679391 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:36:58.693516 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0] added Jun 26 10:36:58.693516 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:36:58.693516 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:36:58.693516 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:36:58.693516 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:36:58.693516 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:36:58.693516 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:36:58.698427 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Allocating IP information in the background. {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 26 10:36:58.699086 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] allocate_for_instance() {{(pid=98967) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 26 10:36:58.699439 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:36:58.699781 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:36:58.701452 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0] added Jun 26 10:36:58.701452 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:36:58.701452 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:36:58.701452 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:36:58.701452 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:36:58.701452 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:36:58.701452 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:36:58.703983 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:36:58.707724 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:36:58.707724 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0527(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:36:58.708095 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:36:58.709827 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0489(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:36:58.709827 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:36:58.744324 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:36:58.780678 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:36:58.786665 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:36:58.841574 np0000003731 nova-compute[98967]: DEBUG nova.policy [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '969d94ff13fa470c8c07bc5e419d3e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4242a2b73cf4564ac8f9f2cb9c7a7bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98967) authorize /opt/stack/nova/nova/policy.py:192}} Jun 26 10:36:59.008625 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:36:59.180190 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Took 11.46 seconds to spawn the instance on the hypervisor. Jun 26 10:36:59.180190 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:36:59.180325 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Took 13.71 seconds to spawn the instance on the hypervisor. Jun 26 10:36:59.180482 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:36:59.212472 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 26 10:36:59.254645 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Updating instance_info_cache with network_info: [{"id": "85e3464e-eadb-4a6d-b3b5-073945346160", "address": "fa:16:3e:56:c7:74", "network": {"id": "640dfe2a-db65-4dfd-a073-17ac7680d2b0", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1874770241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f37c91742d834881a1ec62e1eb1ecdcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e3464e-ea", "ovs_interfaceid": "85e3464e-eadb-4a6d-b3b5-073945346160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:36:59.286475 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:36:59.289415 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:36:59.290582 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: d48c4183-618a-4abc-9d4c-956576c74490] During sync_power_state the instance has a pending task (spawning). Skip. Jun 26 10:36:59.290850 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b22edf7fe39f6aefea5a3e90a11c470f2176d698.part --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:36:59.291093 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:36:59.291224 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] VM Resumed (Lifecycle Event) Jun 26 10:36:59.375647 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b22edf7fe39f6aefea5a3e90a11c470f2176d698.part --force-share --output=json" returned: 0 in 0.085s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:36:59.376170 np0000003731 nova-compute[98967]: DEBUG nova.virt.images [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] c7762ac8-b995-4f2a-95ee-9f4f6fdb855d was qcow2, converting to raw {{(pid=98967) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 26 10:36:59.377290 np0000003731 nova-compute[98967]: DEBUG nova.privsep.utils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98967) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 26 10:36:59.377655 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b22edf7fe39f6aefea5a3e90a11c470f2176d698.part /opt/stack/data/nova/instances/_base/b22edf7fe39f6aefea5a3e90a11c470f2176d698.converted {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:36:59.558492 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Successfully created port: f3b40b67-c684-437c-83df-5ff22d2249e8 {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:36:59.581460 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/b22edf7fe39f6aefea5a3e90a11c470f2176d698.part /opt/stack/data/nova/instances/_base/b22edf7fe39f6aefea5a3e90a11c470f2176d698.converted" returned: 0 in 0.203s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:36:59.586749 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b22edf7fe39f6aefea5a3e90a11c470f2176d698.converted --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:36:59.676822 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b22edf7fe39f6aefea5a3e90a11c470f2176d698.converted --force-share --output=json" returned: 0 in 0.090s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:36:59.677705 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "b22edf7fe39f6aefea5a3e90a11c470f2176d698" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.483s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:36:59.678252 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:36:59.681303 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:36:59.682521 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b22edf7fe39f6aefea5a3e90a11c470f2176d698 --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:36:59.709601 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:36:59.710771 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:36:59.717094 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Took 18.90 seconds to build instance. Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.40.100 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:36:59.727562 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:36:59.730856 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Start building block device mappings for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.50.100 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:36:59.740951 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:36:59.745391 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Took 19.07 seconds to build instance. Jun 26 10:36:59.746742 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:36:59.756623 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:36:59.759124 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:36:59.759307 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Releasing lock "refresh_cache-c43215aa-be15-4556-8162-bcd9793048c0" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:36:59.759653 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:36:59.762467 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Instance network_info: |[{"id": "85e3464e-eadb-4a6d-b3b5-073945346160", "address": "fa:16:3e:56:c7:74", "network": {"id": "640dfe2a-db65-4dfd-a073-17ac7680d2b0", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1874770241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f37c91742d834881a1ec62e1eb1ecdcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e3464e-ea", "ovs_interfaceid": "85e3464e-eadb-4a6d-b3b5-073945346160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 26 10:36:59.763059 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] Acquired lock "refresh_cache-c43215aa-be15-4556-8162-bcd9793048c0" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:36:59.764141 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Refreshing network info cache for port 85e3464e-eadb-4a6d-b3b5-073945346160 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:36:59.769002 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jun 26 10:36:59.769002 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:36:59.769370 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jun 26 10:36:59.769370 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:36:59.769851 np0000003731 nova-compute[98967]: WARNING os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jun 26 10:36:59.769851 np0000003731 nova-compute[98967]: Jun 26 10:36:59.775018 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('-m', 'session'): stdout= stderr=iscsiadm: No active sessions. Jun 26 10:36:59.775018 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:36:59.775688 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsi session list stdout= stderr=iscsiadm: No active sessions. Jun 26 10:36:59.775688 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:36:59.775688 np0000003731 nova-compute[98967]: WARNING os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm stderr output when getting sessions: iscsiadm: No active sessions. Jun 26 10:36:59.775688 np0000003731 nova-compute[98967]: Jun 26 10:36:59.777083 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b22edf7fe39f6aefea5a3e90a11c470f2176d698 --force-share --output=json" returned: 0 in 0.094s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:36:59.777455 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Acquiring lock "b22edf7fe39f6aefea5a3e90a11c470f2176d698" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:36:59.777879 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "b22edf7fe39f6aefea5a3e90a11c470f2176d698" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:36:59.778302 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:36:59.783893 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:36:59.784358 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b22edf7fe39f6aefea5a3e90a11c470f2176d698 --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:36:59.811260 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:36:59.813261 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:36:59.862455 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b22edf7fe39f6aefea5a3e90a11c470f2176d698 --force-share --output=json" returned: 0 in 0.078s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:36:59.862937 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b22edf7fe39f6aefea5a3e90a11c470f2176d698,backing_fmt=raw /opt/stack/data/nova/instances/c43215aa-be15-4556-8162-bcd9793048c0/disk 1073741824 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:36:59.902437 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/b22edf7fe39f6aefea5a3e90a11c470f2176d698,backing_fmt=raw /opt/stack/data/nova/instances/c43215aa-be15-4556-8162-bcd9793048c0/disk 1073741824" returned: 0 in 0.039s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:36:59.902924 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "b22edf7fe39f6aefea5a3e90a11c470f2176d698" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.125s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:36:59.903260 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b22edf7fe39f6aefea5a3e90a11c470f2176d698 --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:36:59.980167 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/b22edf7fe39f6aefea5a3e90a11c470f2176d698 --force-share --output=json" returned: 0 in 0.076s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:36:59.980706 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c43215aa-be15-4556-8162-bcd9793048c0/disk. size=1073741824 {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 26 10:36:59.980993 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43215aa-be15-4556-8162-bcd9793048c0/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:00.056476 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43215aa-be15-4556-8162-bcd9793048c0/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:00.056873 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Cannot resize image /opt/stack/data/nova/instances/c43215aa-be15-4556-8162-bcd9793048c0/disk to a smaller size. {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 26 10:37:00.057237 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Created local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 26 10:37:00.057388 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Ensure instance console log exists: /opt/stack/data/nova/instances/c43215aa-be15-4556-8162-bcd9793048c0/console.log {{(pid=98967) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 26 10:37:00.057725 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:00.057975 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:00.058685 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:00.059985 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Start _get_guest_xml network_info=[{"id": "85e3464e-eadb-4a6d-b3b5-073945346160", "address": "fa:16:3e:56:c7:74", "network": {"id": "640dfe2a-db65-4dfd-a073-17ac7680d2b0", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1874770241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f37c91742d834881a1ec62e1eb1ecdcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e3464e-ea", "ovs_interfaceid": "85e3464e-eadb-4a6d-b3b5-073945346160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'scsi', 'cdrom_bus': 'scsi', 'mapping': {'root': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'scsi', 'dev': 'sda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'scsi', 'dev': 'sdb', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:36:44Z,direct_url=,disk_format='qcow2',id=c7762ac8-b995-4f2a-95ee-9f4f6fdb855d,min_disk=0,min_ram=0,name='',owner='c56fb1f247d145dc9739a0d96728ce79',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:36:47Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/sda', 'image': [{'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'size': 0, 'disk_bus': 'scsi', 'device_name': '/dev/sda', 'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'image_id': 'c7762ac8-b995-4f2a-95ee-9f4f6fdb855d'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:37:00.066807 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:37:00.068330 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='c7762ac8-b995-4f2a-95ee-9f4f6fdb855d', instance_meta=NovaInstanceMeta(name='tempest-AttachSCSIVolumeTestJSON-server-18998337', uuid='c43215aa-be15-4556-8162-bcd9793048c0'), owner=OwnerMeta(userid='c121ca0bdcf24093be4959e77345c328', username='tempest-AttachSCSIVolumeTestJSON-1664188932-project-member', projectid='f37c91742d834881a1ec62e1eb1ecdcf', projectname='tempest-AttachSCSIVolumeTestJSON-1664188932'), image=ImageMeta(id='c7762ac8-b995-4f2a-95ee-9f4f6fdb855d', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'scsi', 'hw_disk_bus': 'scsi', 'hw_scsi_model': 'virtio-scsi'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "85e3464e-eadb-4a6d-b3b5-073945346160", "address": "fa:16:3e:56:c7:74", "network": {"id": "640dfe2a-db65-4dfd-a073-17ac7680d2b0", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1874770241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f37c91742d834881a1ec62e1eb1ecdcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e3464e-ea", "ovs_interfaceid": "85e3464e-eadb-4a6d-b3b5-073945346160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470220.067913) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:37:00.069627 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:37:00.069981 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:37:00.071185 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:37:00.071425 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:37:00.072726 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:37:00.073034 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:36:44Z,direct_url=,disk_format='qcow2',id=c7762ac8-b995-4f2a-95ee-9f4f6fdb855d,min_disk=0,min_ram=0,name='',owner='c56fb1f247d145dc9739a0d96728ce79',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:36:47Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:37:00.073238 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:37:00.073365 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:37:00.073603 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:37:00.073738 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:37:00.073873 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:37:00.074081 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:37:00.074215 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:37:00.074322 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:37:00.074417 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:37:00.074568 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:37:00.087706 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:36:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-18998337',display_name='tempest-AttachSCSIVolumeTestJSON-server-18998337',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-attachscsivolumetestjson-server-18998337',id=4,image_ref='c7762ac8-b995-4f2a-95ee-9f4f6fdb855d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0hytWFUYbgBKclliRTkCyGe+x/WtHIDBhuf3tDCCDrHQ6HoV1OrTysz56hJWDdo2yh09ZOgzNBJu6oWGcUZ35ElB4GdjfCUuaXkg7q+zshkdODr42ewwRXnRS/Hc7xAg==',key_name='tempest-keypair-1365391156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f37c91742d834881a1ec62e1eb1ecdcf',ramdisk_id='',reservation_id='r-cb6tcf00',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c7762ac8-b995-4f2a-95ee-9f4f6fdb855d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1664188932',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1664188932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:36:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c121ca0bdcf24093be4959e77345c328',uuid=c43215aa-be15-4556-8162-bcd9793048c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85e3464e-eadb-4a6d-b3b5-073945346160", "address": "fa:16:3e:56:c7:74", "network": {"id": "640dfe2a-db65-4dfd-a073-17ac7680d2b0", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1874770241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f37c91742d834881a1ec62e1eb1ecdcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e3464e-ea", "ovs_interfaceid": "85e3464e-eadb-4a6d-b3b5-073945346160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:37:00.087979 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Converting VIF {"id": "85e3464e-eadb-4a6d-b3b5-073945346160", "address": "fa:16:3e:56:c7:74", "network": {"id": "640dfe2a-db65-4dfd-a073-17ac7680d2b0", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1874770241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f37c91742d834881a1ec62e1eb1ecdcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e3464e-ea", "ovs_interfaceid": "85e3464e-eadb-4a6d-b3b5-073945346160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:00.088888 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:c7:74,bridge_name='br-int',has_traffic_filtering=True,id=85e3464e-eadb-4a6d-b3b5-073945346160,network=Network(640dfe2a-db65-4dfd-a073-17ac7680d2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e3464e-ea') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:00.089803 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lazy-loading 'pci_devices' on Instance uuid c43215aa-be15-4556-8162-bcd9793048c0 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:37:00.226947 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40b18868-8901-4fae-9fe3-e6c36a9a07d3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 20.418s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:00.232394 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Successfully updated port: f3b40b67-c684-437c-83df-5ff22d2249e8 {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:37:00.244999 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0910cee8-f21d-449e-8cf3-1954305c3f51 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "d48c4183-618a-4abc-9d4c-956576c74490" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 20.586s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:00.264238 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:37:00.271770 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:00.321680 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-9fab9af3-b1d8-4a08-b5ef-fa642d21567d req-9ef5f532-bf48-4523-bfc2-343627c0d0fd service nova] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Received event network-changed-f3b40b67-c684-437c-83df-5ff22d2249e8 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:00.321828 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-9fab9af3-b1d8-4a08-b5ef-fa642d21567d req-9ef5f532-bf48-4523-bfc2-343627c0d0fd service nova] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Refreshing instance network info cache due to event network-changed-f3b40b67-c684-437c-83df-5ff22d2249e8. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:37:00.322326 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-9fab9af3-b1d8-4a08-b5ef-fa642d21567d req-9ef5f532-bf48-4523-bfc2-343627c0d0fd service nova] Acquiring lock "refresh_cache-0b93909a-db10-4b65-b5a7-0aa3f0a47da7" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:00.322422 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-9fab9af3-b1d8-4a08-b5ef-fa642d21567d req-9ef5f532-bf48-4523-bfc2-343627c0d0fd service nova] Acquired lock "refresh_cache-0b93909a-db10-4b65-b5a7-0aa3f0a47da7" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:00.322800 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-9fab9af3-b1d8-4a08-b5ef-fa642d21567d req-9ef5f532-bf48-4523-bfc2-343627c0d0fd service nova] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Refreshing network info cache for port f3b40b67-c684-437c-83df-5ff22d2249e8 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] End _get_guest_xml xml= Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: c43215aa-be15-4556-8162-bcd9793048c0 Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: instance-00000004 Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: 196608 Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: tempest-AttachSCSIVolumeTestJSON-server-18998337 Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: 2026-06-26 10:37:00 Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: 192 Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: True Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: bare Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: scsi Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: scsi Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: virtio-scsi Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: tempest-AttachSCSIVolumeTestJSON-1664188932-project-member Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: tempest-AttachSCSIVolumeTestJSON-1664188932 Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: c43215aa-be15-4556-8162-bcd9793048c0 Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: c43215aa-be15-4556-8162-bcd9793048c0 Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: hvm Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: 128 Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]:
Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]:
Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: Jun 26 10:37:00.594152 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:37:00.596156 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Preparing to wait for external event network-vif-plugged-85e3464e-eadb-4a6d-b3b5-073945346160 {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:37:00.596156 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Acquiring lock "c43215aa-be15-4556-8162-bcd9793048c0-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:00.596156 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "c43215aa-be15-4556-8162-bcd9793048c0-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:00.596156 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "c43215aa-be15-4556-8162-bcd9793048c0-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:00.596156 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:36:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-18998337',display_name='tempest-AttachSCSIVolumeTestJSON-server-18998337',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-attachscsivolumetestjson-server-18998337',id=4,image_ref='c7762ac8-b995-4f2a-95ee-9f4f6fdb855d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0hytWFUYbgBKclliRTkCyGe+x/WtHIDBhuf3tDCCDrHQ6HoV1OrTysz56hJWDdo2yh09ZOgzNBJu6oWGcUZ35ElB4GdjfCUuaXkg7q+zshkdODr42ewwRXnRS/Hc7xAg==',key_name='tempest-keypair-1365391156',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f37c91742d834881a1ec62e1eb1ecdcf',ramdisk_id='',reservation_id='r-cb6tcf00',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c7762ac8-b995-4f2a-95ee-9f4f6fdb855d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_machine_type='pc',image_hw_scsi_model='virtio-scsi',image_min_disk='1',image_min_ram='0',network_allocated='True',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1664188932',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1664188932-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:36:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c121ca0bdcf24093be4959e77345c328',uuid=c43215aa-be15-4556-8162-bcd9793048c0,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "85e3464e-eadb-4a6d-b3b5-073945346160", "address": "fa:16:3e:56:c7:74", "network": {"id": "640dfe2a-db65-4dfd-a073-17ac7680d2b0", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1874770241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f37c91742d834881a1ec62e1eb1ecdcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e3464e-ea", "ovs_interfaceid": "85e3464e-eadb-4a6d-b3b5-073945346160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:37:00.596379 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Converting VIF {"id": "85e3464e-eadb-4a6d-b3b5-073945346160", "address": "fa:16:3e:56:c7:74", "network": {"id": "640dfe2a-db65-4dfd-a073-17ac7680d2b0", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1874770241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f37c91742d834881a1ec62e1eb1ecdcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e3464e-ea", "ovs_interfaceid": "85e3464e-eadb-4a6d-b3b5-073945346160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:00.597654 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:56:c7:74,bridge_name='br-int',has_traffic_filtering=True,id=85e3464e-eadb-4a6d-b3b5-073945346160,network=Network(640dfe2a-db65-4dfd-a073-17ac7680d2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e3464e-ea') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:00.597988 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:c7:74,bridge_name='br-int',has_traffic_filtering=True,id=85e3464e-eadb-4a6d-b3b5-073945346160,network=Network(640dfe2a-db65-4dfd-a073-17ac7680d2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e3464e-ea') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:37:00.598616 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:00.599014 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:00.599345 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:37:00.600190 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:00.600375 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '23aae1f5-0ed5-52e9-aaa9-b6a5fbb58b6a', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:00.601195 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:00.602182 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:00.604204 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:00.610837 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:00.610978 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap85e3464e-ea, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:00.611369 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap85e3464e-ea, col_values=(('qos', UUID('ad29d746-0627-488f-8981-a2007d838045')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:00.611581 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap85e3464e-ea, col_values=(('external_ids', {'iface-id': '85e3464e-eadb-4a6d-b3b5-073945346160', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:56:c7:74', 'vm-uuid': 'c43215aa-be15-4556-8162-bcd9793048c0'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:00.612621 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:00.614054 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:00.621472 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:00.622752 np0000003731 nova-compute[98967]: INFO os_vif [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:56:c7:74,bridge_name='br-int',has_traffic_filtering=True,id=85e3464e-eadb-4a6d-b3b5-073945346160,network=Network(640dfe2a-db65-4dfd-a073-17ac7680d2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e3464e-ea') Jun 26 10:37:00.700956 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:00.734793 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "refresh_cache-0b93909a-db10-4b65-b5a7-0aa3f0a47da7" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:00.744231 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Start spawning the instance on the hypervisor. {{(pid=98967) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 26 10:37:00.745341 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Creating instance directory {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 26 10:37:00.745685 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Creating image(s) Jun 26 10:37:00.747951 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "/opt/stack/data/nova/instances/0b93909a-db10-4b65-b5a7-0aa3f0a47da7/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:00.748422 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "/opt/stack/data/nova/instances/0b93909a-db10-4b65-b5a7-0aa3f0a47da7/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.002s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:00.749737 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "/opt/stack/data/nova/instances/0b93909a-db10-4b65-b5a7-0aa3f0a47da7/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:00.751705 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:00.759838 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:00.761880 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:00.784845 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.605s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:00.785854 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Start building networks asynchronously for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 26 10:37:00.793146 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 4.655s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:00.807864 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98967) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 26 10:37:00.810156 np0000003731 nova-compute[98967]: INFO nova.compute.claims [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Claim successful on node np0000003731 Jun 26 10:37:00.815039 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0, portal: 192.168.40.100,3260] Jun 26 10:37:00.815039 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0, portal: 192.168.40.100,3260] successful. Jun 26 10:37:00.815039 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:00.816014 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0, portal: 192.168.50.100,3260] Jun 26 10:37:00.816014 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0, portal: 192.168.50.100,3260] successful. Jun 26 10:37:00.816014 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:00.826218 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:00.827454 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-9fab9af3-b1d8-4a08-b5ef-fa642d21567d req-9ef5f532-bf48-4523-bfc2-343627c0d0fd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:00.832828 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:00.840980 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:00.840980 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:00.840980 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:00.841231 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:00.841231 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:00.841231 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:00.841849 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.187s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:37:00.842058 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Connected to 192.168.40.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:37:00.843342 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] HCTL ('7', '-', '-', 0) found on session 2 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:37:00.843611 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Scanning host 7 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:37:00.849681 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.088s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:00.850053 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:00.852346 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.002s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:00.852979 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:00.856156 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:00.857374 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:00.857374 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:00.857374 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:00.857856 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:00.858667 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:00.858667 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:00.858667 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:00.858667 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.203s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:37:00.858667 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Connected to 192.168.50.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:37:00.874097 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Searching for a device in session 2 and hctl ['7', '*', '*', 0] yield: sdb {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:37:00.876572 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Connected to sdb using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '231967fc-b56e-42ba-83e3-550c9b1adce0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:37:00.876572 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] HCTL ('8', '-', '-', 0) found on session 3 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:37:00.876572 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Scanning host 8 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:37:00.895363 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Updated VIF entry in instance network info cache for port 85e3464e-eadb-4a6d-b3b5-073945346160. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:37:00.895363 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Updating instance_info_cache with network_info: [{"id": "85e3464e-eadb-4a6d-b3b5-073945346160", "address": "fa:16:3e:56:c7:74", "network": {"id": "640dfe2a-db65-4dfd-a073-17ac7680d2b0", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1874770241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f37c91742d834881a1ec62e1eb1ecdcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e3464e-ea", "ovs_interfaceid": "85e3464e-eadb-4a6d-b3b5-073945346160", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:00.900289 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Searching for a device in session 3 and hctl ['8', '*', '*', 0] yield: sdc {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:37:00.900289 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Connected to sdc using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '231967fc-b56e-42ba-83e3-550c9b1adce0', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:37:00.946347 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.087s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:00.946347 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/0b93909a-db10-4b65-b5a7-0aa3f0a47da7/disk 1073741824 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:00.972806 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-9fab9af3-b1d8-4a08-b5ef-fa642d21567d req-9ef5f532-bf48-4523-bfc2-343627c0d0fd service nova] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:37:00.997886 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/0b93909a-db10-4b65-b5a7-0aa3f0a47da7/disk 1073741824" returned: 0 in 0.052s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:00.999341 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.147s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:00.999723 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:01.080348 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.079s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:01.080348 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0b93909a-db10-4b65-b5a7-0aa3f0a47da7/disk. size=1073741824 {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 26 10:37:01.080348 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b93909a-db10-4b65-b5a7-0aa3f0a47da7/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:01.160560 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b93909a-db10-4b65-b5a7-0aa3f0a47da7/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:01.160726 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Cannot resize image /opt/stack/data/nova/instances/0b93909a-db10-4b65-b5a7-0aa3f0a47da7/disk to a smaller size. {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 26 10:37:01.161145 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Created local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 26 10:37:01.161438 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Ensure instance console log exists: /opt/stack/data/nova/instances/0b93909a-db10-4b65-b5a7-0aa3f0a47da7/console.log {{(pid=98967) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 26 10:37:01.161717 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:01.161988 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:01.162182 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:01.178824 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Acquiring lock "d48c4183-618a-4abc-9d4c-956576c74490" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:01.179205 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "d48c4183-618a-4abc-9d4c-956576c74490" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:01.192456 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-9fab9af3-b1d8-4a08-b5ef-fa642d21567d req-9ef5f532-bf48-4523-bfc2-343627c0d0fd service nova] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:01.305481 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Allocating IP information in the background. {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 26 10:37:01.305734 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] allocate_for_instance() {{(pid=98967) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 26 10:37:01.306268 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:01.306643 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:01.395825 np0000003731 nova-compute[98967]: DEBUG nova.policy [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '969d94ff13fa470c8c07bc5e419d3e13', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4242a2b73cf4564ac8f9f2cb9c7a7bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98967) authorize /opt/stack/nova/nova/policy.py:192}} Jun 26 10:37:01.397921 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7a11eafa-01c0-4caa-932d-ae75aafe4f2f req-a014ff2c-dff4-4933-8667-d69d54de73ab service nova] Releasing lock "refresh_cache-c43215aa-be15-4556-8162-bcd9793048c0" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:01.655194 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 26 10:37:01.683395 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lazy-loading 'flavor' on Instance uuid d48c4183-618a-4abc-9d4c-956576c74490 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:37:01.696490 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-9fab9af3-b1d8-4a08-b5ef-fa642d21567d req-9ef5f532-bf48-4523-bfc2-343627c0d0fd service nova] Releasing lock "refresh_cache-0b93909a-db10-4b65-b5a7-0aa3f0a47da7" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:01.696938 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquired lock "refresh_cache-0b93909a-db10-4b65-b5a7-0aa3f0a47da7" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:01.697176 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:37:01.809091 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 26 10:37:02.150519 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] No BDM found with device name sda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:02.150884 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:02.150884 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] No VIF found with MAC fa:16:3e:56:c7:74, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:37:02.151530 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Using config drive Jun 26 10:37:02.243074 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Successfully created port: 2608654f-5761-4d82-a2ab-2a67e20a1c08 {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:37:02.314065 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Start building block device mappings for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 26 10:37:02.322973 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:37:02.354690 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:02.357470 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:37:02.357862 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:37:02.519316 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-d1c72ef0-9a99-4481-86ab-0083e9d2e817 req-7305ad9e-65b8-4733-9585-ae4a0dc7d526 service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Received event network-changed-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:02.519538 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-d1c72ef0-9a99-4481-86ab-0083e9d2e817 req-7305ad9e-65b8-4733-9585-ae4a0dc7d526 service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Refreshing instance network info cache due to event network-changed-b6ae095e-5da6-45dd-95bd-47cf007120c3. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:37:02.519715 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-d1c72ef0-9a99-4481-86ab-0083e9d2e817 req-7305ad9e-65b8-4733-9585-ae4a0dc7d526 service nova] Acquiring lock "refresh_cache-81a0f65d-2017-4275-aabe-88bc8c81225d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:02.519863 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-d1c72ef0-9a99-4481-86ab-0083e9d2e817 req-7305ad9e-65b8-4733-9585-ae4a0dc7d526 service nova] Acquired lock "refresh_cache-81a0f65d-2017-4275-aabe-88bc8c81225d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:02.520145 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-d1c72ef0-9a99-4481-86ab-0083e9d2e817 req-7305ad9e-65b8-4733-9585-ae4a0dc7d526 service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Refreshing network info cache for port b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:37:02.628982 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:02.660570 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:02.673825 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Found WWN 330000000543c1bc2 for multipath device dm-0 {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 26 10:37:02.674207 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.037s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:37:02.674359 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] <== connect_volume: return (4036ms) {'type': 'block', 'scsi_wwn': '330000000543c1bc2', 'path': '/dev/dm-0', 'multipath_id': '330000000543c1bc2'} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:37:02.676358 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000543c1bc2', 'path': '/dev/dm-0', 'multipath_id': '330000000543c1bc2'} {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 26 10:37:02.703805 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "d48c4183-618a-4abc-9d4c-956576c74490" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.510s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:02.800399 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Updating instance_info_cache with network_info: [{"id": "f3b40b67-c684-437c-83df-5ff22d2249e8", "address": "fa:16:3e:f2:01:1a", "network": {"id": "ee9d6726-90f0-4fdf-978b-d97dc4dc243d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1209858046-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b4242a2b73cf4564ac8f9f2cb9c7a7bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b40b67-c6", "ovs_interfaceid": "f3b40b67-c684-437c-83df-5ff22d2249e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:02.860787 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:37:02.949463 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Creating config drive at /opt/stack/data/nova/instances/c43215aa-be15-4556-8162-bcd9793048c0/disk.config Jun 26 10:37:02.960805 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c43215aa-be15-4556-8162-bcd9793048c0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmmcqwnme {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:03.002088 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c43215aa-be15-4556-8162-bcd9793048c0/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpmmcqwnme" returned: 0 in 0.041s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:03.036117 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-d1c72ef0-9a99-4481-86ab-0083e9d2e817 req-7305ad9e-65b8-4733-9585-ae4a0dc7d526 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:03.185122 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:36:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-923442882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-attachvolumemultiattachtest-server-923442882',id=3,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49c2798faed447838b6c87f6d15cce66',ramdisk_id='',reservation_id='r-vwfiewaf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1668992443',owner_user_name='tempest-AttachVolumeMultiAttachTest-1668992443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:36:55Z,user_data=None,user_id='8a8a0b0240a34fb0bcf62ee7ec259cb2',uuid=d26dc4db-d71c-43b9-811a-d39b111be119,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d9b0e94-555b-490b-a3bc-898d6821b394", "address": "fa:16:3e:37:b3:f6", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9b0e94-55", "ovs_interfaceid": "7d9b0e94-555b-490b-a3bc-898d6821b394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:37:03.185122 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Converting VIF {"id": "7d9b0e94-555b-490b-a3bc-898d6821b394", "address": "fa:16:3e:37:b3:f6", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9b0e94-55", "ovs_interfaceid": "7d9b0e94-555b-490b-a3bc-898d6821b394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:03.186037 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:b3:f6,bridge_name='br-int',has_traffic_filtering=True,id=7d9b0e94-555b-490b-a3bc-898d6821b394,network=Network(204eb6a3-9452-412e-ab0b-1594eb86bed2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d9b0e94-55') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:03.187546 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lazy-loading 'pci_devices' on Instance uuid d26dc4db-d71c-43b9-811a-d39b111be119 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:37:03.270819 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Successfully updated port: 2608654f-5761-4d82-a2ab-2a67e20a1c08 {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:37:03.300203 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Releasing lock "refresh_cache-0b93909a-db10-4b65-b5a7-0aa3f0a47da7" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:03.300621 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Instance network_info: |[{"id": "f3b40b67-c684-437c-83df-5ff22d2249e8", "address": "fa:16:3e:f2:01:1a", "network": {"id": "ee9d6726-90f0-4fdf-978b-d97dc4dc243d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1209858046-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b4242a2b73cf4564ac8f9f2cb9c7a7bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b40b67-c6", "ovs_interfaceid": "f3b40b67-c684-437c-83df-5ff22d2249e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 26 10:37:03.304753 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Start _get_guest_xml network_info=[{"id": "f3b40b67-c684-437c-83df-5ff22d2249e8", "address": "fa:16:3e:f2:01:1a", "network": {"id": "ee9d6726-90f0-4fdf-978b-d97dc4dc243d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1209858046-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b4242a2b73cf4564ac8f9f2cb9c7a7bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b40b67-c6", "ovs_interfaceid": "f3b40b67-c684-437c-83df-5ff22d2249e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'image_id': 'a9b18127-6fee-4ed6-b364-a2d634ecb8b7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:37:03.316602 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:37:03.318434 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-574467017-1', uuid='0b93909a-db10-4b65-b5a7-0aa3f0a47da7'), owner=OwnerMeta(userid='969d94ff13fa470c8c07bc5e419d3e13', username='tempest-TestMultiAttachVolumeSwap-1408323251-project-member', projectid='b4242a2b73cf4564ac8f9f2cb9c7a7bf', projectname='tempest-TestMultiAttachVolumeSwap-1408323251'), image=ImageMeta(id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "f3b40b67-c684-437c-83df-5ff22d2249e8", "address": "fa:16:3e:f2:01:1a", "network": {"id": "ee9d6726-90f0-4fdf-978b-d97dc4dc243d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1209858046-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b4242a2b73cf4564ac8f9f2cb9c7a7bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b40b67-c6", "ovs_interfaceid": "f3b40b67-c684-437c-83df-5ff22d2249e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470223.3179114) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:37:03.325158 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Start spawning the instance on the hypervisor. {{(pid=98967) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 26 10:37:03.328409 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:37:03.328812 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:37:03.329985 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:37:03.330150 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:37:03.331147 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:37:03.331497 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:37:03.331674 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:37:03.331837 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:37:03.331837 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:37:03.331953 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:37:03.332154 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:37:03.332268 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:37:03.332424 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:37:03.332574 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:37:03.332731 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:37:03.333751 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:37:03.333751 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Creating instance directory {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 26 10:37:03.339602 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Creating image(s) Jun 26 10:37:03.350091 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "/opt/stack/data/nova/instances/64a636b4-e106-4968-8740-9938e9b2bcc8/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:03.351189 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-574467017-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-testmultiattachvolumeswap-server-574467017-1',id=5,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSbRbM1YJq9Ia0wxRJgshSkjCUzmlOfS3KQV3f22/KUIjk7ds3Wz4HXS6ODe9kZD4ztp/Tqp7VDqOLvvsbyqTpmrjlrWC9hHWD73OsN3TnhrYQef72rYY9KvkUUZJbIrA==',key_name='tempest-keypair-932697520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4242a2b73cf4564ac8f9f2cb9c7a7bf',ramdisk_id='',reservation_id='r-rdkz1jh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1408323251',owner_user_name='tempest-TestMultiAttachVolumeSwap-1408323251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='969d94ff13fa470c8c07bc5e419d3e13',uuid=0b93909a-db10-4b65-b5a7-0aa3f0a47da7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3b40b67-c684-437c-83df-5ff22d2249e8", "address": "fa:16:3e:f2:01:1a", "network": {"id": "ee9d6726-90f0-4fdf-978b-d97dc4dc243d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1209858046-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b4242a2b73cf4564ac8f9f2cb9c7a7bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b40b67-c6", "ovs_interfaceid": "f3b40b67-c684-437c-83df-5ff22d2249e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:37:03.351526 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-ea5bb605-41f2-4c3e-9b1d-31d367033511 req-35a55e01-d5cc-4e2d-b7eb-58cd113a71a0 service nova] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Received event network-changed-2608654f-5761-4d82-a2ab-2a67e20a1c08 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:03.351786 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "/opt/stack/data/nova/instances/64a636b4-e106-4968-8740-9938e9b2bcc8/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.004s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:03.352035 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Converting VIF {"id": "f3b40b67-c684-437c-83df-5ff22d2249e8", "address": "fa:16:3e:f2:01:1a", "network": {"id": "ee9d6726-90f0-4fdf-978b-d97dc4dc243d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1209858046-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b4242a2b73cf4564ac8f9f2cb9c7a7bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b40b67-c6", "ovs_interfaceid": "f3b40b67-c684-437c-83df-5ff22d2249e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:03.352729 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-ea5bb605-41f2-4c3e-9b1d-31d367033511 req-35a55e01-d5cc-4e2d-b7eb-58cd113a71a0 service nova] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Refreshing instance network info cache due to event network-changed-2608654f-5761-4d82-a2ab-2a67e20a1c08. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:37:03.353608 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:01:1a,bridge_name='br-int',has_traffic_filtering=True,id=f3b40b67-c684-437c-83df-5ff22d2249e8,network=Network(ee9d6726-90f0-4fdf-978b-d97dc4dc243d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3b40b67-c6') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:03.354444 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-ea5bb605-41f2-4c3e-9b1d-31d367033511 req-35a55e01-d5cc-4e2d-b7eb-58cd113a71a0 service nova] Acquiring lock "refresh_cache-64a636b4-e106-4968-8740-9938e9b2bcc8" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:03.354761 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lazy-loading 'pci_devices' on Instance uuid 0b93909a-db10-4b65-b5a7-0aa3f0a47da7 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:37:03.356089 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-ea5bb605-41f2-4c3e-9b1d-31d367033511 req-35a55e01-d5cc-4e2d-b7eb-58cd113a71a0 service nova] Acquired lock "refresh_cache-64a636b4-e106-4968-8740-9938e9b2bcc8" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:03.357917 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "/opt/stack/data/nova/instances/64a636b4-e106-4968-8740-9938e9b2bcc8/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.006s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:03.358315 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-ea5bb605-41f2-4c3e-9b1d-31d367033511 req-35a55e01-d5cc-4e2d-b7eb-58cd113a71a0 service nova] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Refreshing network info cache for port 2608654f-5761-4d82-a2ab-2a67e20a1c08 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:37:03.365103 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:03.370417 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:03.372952 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.581s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:03.374249 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Start building networks asynchronously for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 26 10:37:03.383735 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:03.452782 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.069s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:03.453288 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:03.453852 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:03.454342 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:03.456885 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:03.457245 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:03.495140 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:03.523034 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:03.526438 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:03.543835 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.085s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:03.543835 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/64a636b4-e106-4968-8740-9938e9b2bcc8/disk 1073741824 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:03.586886 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/64a636b4-e106-4968-8740-9938e9b2bcc8/disk 1073741824" returned: 0 in 0.043s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:03.592447 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.138s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:03.592834 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:03.620511 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:03.689721 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.097s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:03.691938 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Checking if we can resize image /opt/stack/data/nova/instances/64a636b4-e106-4968-8740-9938e9b2bcc8/disk. size=1073741824 {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] End _get_guest_xml xml= Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: d26dc4db-d71c-43b9-811a-d39b111be119 Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: instance-00000003 Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: 196608 Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: tempest-AttachVolumeMultiAttachTest-server-923442882 Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: 2026-06-26 10:36:58 Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: 192 Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: True Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: virtio Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: tempest-AttachVolumeMultiAttachTest-1668992443-project-member Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: tempest-AttachVolumeMultiAttachTest-1668992443 Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: d26dc4db-d71c-43b9-811a-d39b111be119 Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: d26dc4db-d71c-43b9-811a-d39b111be119 Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: hvm Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: 128 Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: 231967fc-b56e-42ba-83e3-550c9b1adce0 Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: Jun 26 10:37:03.692162 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:37:03.694911 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64a636b4-e106-4968-8740-9938e9b2bcc8/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:03.694911 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Preparing to wait for external event network-vif-plugged-7d9b0e94-555b-490b-a3bc-898d6821b394 {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:37:03.694911 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "d26dc4db-d71c-43b9-811a-d39b111be119-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:03.694911 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "d26dc4db-d71c-43b9-811a-d39b111be119-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:03.694911 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "d26dc4db-d71c-43b9-811a-d39b111be119-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:03.695522 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:36:48Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeMultiAttachTest-server-923442882',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-attachvolumemultiattachtest-server-923442882',id=3,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49c2798faed447838b6c87f6d15cce66',ramdisk_id='',reservation_id='r-vwfiewaf',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',image_signature_verified='False',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1668992443',owner_user_name='tempest-AttachVolumeMultiAttachTest-1668992443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:36:55Z,user_data=None,user_id='8a8a0b0240a34fb0bcf62ee7ec259cb2',uuid=d26dc4db-d71c-43b9-811a-d39b111be119,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7d9b0e94-555b-490b-a3bc-898d6821b394", "address": "fa:16:3e:37:b3:f6", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9b0e94-55", "ovs_interfaceid": "7d9b0e94-555b-490b-a3bc-898d6821b394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:37:03.695625 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Converting VIF {"id": "7d9b0e94-555b-490b-a3bc-898d6821b394", "address": "fa:16:3e:37:b3:f6", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7d9b0e94-55", "ovs_interfaceid": "7d9b0e94-555b-490b-a3bc-898d6821b394", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:03.696555 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:37:b3:f6,bridge_name='br-int',has_traffic_filtering=True,id=7d9b0e94-555b-490b-a3bc-898d6821b394,network=Network(204eb6a3-9452-412e-ab0b-1594eb86bed2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d9b0e94-55') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:03.696938 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:b3:f6,bridge_name='br-int',has_traffic_filtering=True,id=7d9b0e94-555b-490b-a3bc-898d6821b394,network=Network(204eb6a3-9452-412e-ab0b-1594eb86bed2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d9b0e94-55') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:37:03.697174 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:03.697329 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:03.697919 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:37:03.705633 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:03.707455 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3835bb4b-539c-5e86-88dd-b9f7e7d0c3ed', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:03.710090 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:03.711364 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:03.721183 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:03.721852 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7d9b0e94-55, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:03.721961 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7d9b0e94-55, col_values=(('qos', UUID('d255f0dc-706f-4785-819a-e28696ebca01')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:03.722135 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7d9b0e94-55, col_values=(('external_ids', {'iface-id': '7d9b0e94-555b-490b-a3bc-898d6821b394', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:37:b3:f6', 'vm-uuid': 'd26dc4db-d71c-43b9-811a-d39b111be119'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:03.723242 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:03.725306 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:03.734066 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:03.734956 np0000003731 nova-compute[98967]: INFO os_vif [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:37:b3:f6,bridge_name='br-int',has_traffic_filtering=True,id=7d9b0e94-555b-490b-a3bc-898d6821b394,network=Network(204eb6a3-9452-412e-ab0b-1594eb86bed2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7d9b0e94-55') Jun 26 10:37:03.761668 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "refresh_cache-64a636b4-e106-4968-8740-9938e9b2bcc8" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:03.767779 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64a636b4-e106-4968-8740-9938e9b2bcc8/disk --force-share --output=json" returned: 0 in 0.075s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:03.768517 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Cannot resize image /opt/stack/data/nova/instances/64a636b4-e106-4968-8740-9938e9b2bcc8/disk to a smaller size. {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 26 10:37:03.768677 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Created local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 26 10:37:03.769249 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Ensure instance console log exists: /opt/stack/data/nova/instances/64a636b4-e106-4968-8740-9938e9b2bcc8/console.log {{(pid=98967) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 26 10:37:03.770315 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:03.770315 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:03.770315 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:03.795495 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-d1c72ef0-9a99-4481-86ab-0083e9d2e817 req-7305ad9e-65b8-4733-9585-ae4a0dc7d526 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:03.865954 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-ea5bb605-41f2-4c3e-9b1d-31d367033511 req-35a55e01-d5cc-4e2d-b7eb-58cd113a71a0 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] End _get_guest_xml xml= Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7 Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: instance-00000005 Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: 196608 Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: tempest-TestMultiAttachVolumeSwap-server-574467017-1 Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: 2026-06-26 10:37:03 Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: 192 Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: True Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: bare Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: virtio Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: tempest-TestMultiAttachVolumeSwap-1408323251-project-member Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: tempest-TestMultiAttachVolumeSwap-1408323251 Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7 Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7 Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: hvm Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: 128 Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: Jun 26 10:37:03.868701 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:37:03.875398 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Preparing to wait for external event network-vif-plugged-f3b40b67-c684-437c-83df-5ff22d2249e8 {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:37:03.875398 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:03.875398 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:03.875398 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:03.875398 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-574467017-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-testmultiattachvolumeswap-server-574467017-1',id=5,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSbRbM1YJq9Ia0wxRJgshSkjCUzmlOfS3KQV3f22/KUIjk7ds3Wz4HXS6ODe9kZD4ztp/Tqp7VDqOLvvsbyqTpmrjlrWC9hHWD73OsN3TnhrYQef72rYY9KvkUUZJbIrA==',key_name='tempest-keypair-932697520',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4242a2b73cf4564ac8f9f2cb9c7a7bf',ramdisk_id='',reservation_id='r-rdkz1jh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1408323251',owner_user_name='tempest-TestMultiAttachVolumeSwap-1408323251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:00Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='969d94ff13fa470c8c07bc5e419d3e13',uuid=0b93909a-db10-4b65-b5a7-0aa3f0a47da7,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f3b40b67-c684-437c-83df-5ff22d2249e8", "address": "fa:16:3e:f2:01:1a", "network": {"id": "ee9d6726-90f0-4fdf-978b-d97dc4dc243d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1209858046-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b4242a2b73cf4564ac8f9f2cb9c7a7bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b40b67-c6", "ovs_interfaceid": "f3b40b67-c684-437c-83df-5ff22d2249e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:37:03.875675 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Converting VIF {"id": "f3b40b67-c684-437c-83df-5ff22d2249e8", "address": "fa:16:3e:f2:01:1a", "network": {"id": "ee9d6726-90f0-4fdf-978b-d97dc4dc243d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1209858046-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b4242a2b73cf4564ac8f9f2cb9c7a7bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b40b67-c6", "ovs_interfaceid": "f3b40b67-c684-437c-83df-5ff22d2249e8", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:03.875675 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:01:1a,bridge_name='br-int',has_traffic_filtering=True,id=f3b40b67-c684-437c-83df-5ff22d2249e8,network=Network(ee9d6726-90f0-4fdf-978b-d97dc4dc243d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3b40b67-c6') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:03.875675 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:01:1a,bridge_name='br-int',has_traffic_filtering=True,id=f3b40b67-c684-437c-83df-5ff22d2249e8,network=Network(ee9d6726-90f0-4fdf-978b-d97dc4dc243d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3b40b67-c6') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:37:03.876149 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:03.876460 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:03.876729 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:37:03.877972 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:03.878202 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'eabd2e33-159e-550a-ba62-d92c8086fce2', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:03.882651 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:03.883684 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:03.890545 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:03.898470 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:03.898470 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:03.902333 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf3b40b67-c6, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:03.903522 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf3b40b67-c6, col_values=(('qos', UUID('584b8417-b2a6-4229-8d56-8aed3e5869f6')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:03.903522 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf3b40b67-c6, col_values=(('external_ids', {'iface-id': 'f3b40b67-c684-437c-83df-5ff22d2249e8', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:01:1a', 'vm-uuid': '0b93909a-db10-4b65-b5a7-0aa3f0a47da7'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:03.914415 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:03.918376 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Allocating IP information in the background. {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 26 10:37:03.918642 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] allocate_for_instance() {{(pid=98967) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 26 10:37:03.923726 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:03.925059 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:03.926417 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:03.939846 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:03.939846 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:03.939846 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:03.940134 np0000003731 nova-compute[98967]: INFO os_vif [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:01:1a,bridge_name='br-int',has_traffic_filtering=True,id=f3b40b67-c684-437c-83df-5ff22d2249e8,network=Network(ee9d6726-90f0-4fdf-978b-d97dc4dc243d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3b40b67-c6') Jun 26 10:37:03.976286 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-ea5bb605-41f2-4c3e-9b1d-31d367033511 req-35a55e01-d5cc-4e2d-b7eb-58cd113a71a0 service nova] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:37:04.025021 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-d1c72ef0-9a99-4481-86ab-0083e9d2e817 req-7305ad9e-65b8-4733-9585-ae4a0dc7d526 service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Updated VIF entry in instance network info cache for port b6ae095e-5da6-45dd-95bd-47cf007120c3. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:37:04.025306 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-d1c72ef0-9a99-4481-86ab-0083e9d2e817 req-7305ad9e-65b8-4733-9585-ae4a0dc7d526 service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Updating instance_info_cache with network_info: [{"id": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "address": "fa:16:3e:4c:ec:5e", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ae095e-5d", "ovs_interfaceid": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:04.045067 np0000003731 nova-compute[98967]: DEBUG nova.policy [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '93b18ad8fd1549ebbb429c95feb252b2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f006893b34fb45e7bf33415299ffc934', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98967) authorize /opt/stack/nova/nova/policy.py:192}} Jun 26 10:37:04.218937 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-ea5bb605-41f2-4c3e-9b1d-31d367033511 req-35a55e01-d5cc-4e2d-b7eb-58cd113a71a0 service nova] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:04.427307 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 26 10:37:04.441436 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Starting instance... {{(pid=98967) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 26 10:37:04.477572 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Acquiring lock "d48c4183-618a-4abc-9d4c-956576c74490" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:04.477764 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "d48c4183-618a-4abc-9d4c-956576c74490" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:04.477937 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Attaching volume b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb to /dev/vdb Jun 26 10:37:04.527311 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-d1c72ef0-9a99-4481-86ab-0083e9d2e817 req-7305ad9e-65b8-4733-9585-ae4a0dc7d526 service nova] Releasing lock "refresh_cache-81a0f65d-2017-4275-aabe-88bc8c81225d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:04.529790 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.79', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003731', 'execute': None}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:37:04.548278 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.scaleio [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98967) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 10:37:04.591310 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Running cmd (subprocess): nvme version {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:04.591310 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] 'nvme version' failed. Not Retrying. {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 10:37:04.591310 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] nvme not present on system {{(pid=98967) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 10:37:04.593176 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:04.593326 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c43215aa-be15-4556-8162-bcd9793048c0] VM Started (Lifecycle Event) Jun 26 10:37:04.600326 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-e2be421c-5a59-467f-836d-d3f9411aee64 req-1837a786-7786-43bf-bd83-c506b354ccd6 service nova] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Received event network-vif-unplugged-7d9b0e94-555b-490b-a3bc-898d6821b394 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:04.600682 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-e2be421c-5a59-467f-836d-d3f9411aee64 req-1837a786-7786-43bf-bd83-c506b354ccd6 service nova] Acquiring lock "d26dc4db-d71c-43b9-811a-d39b111be119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:04.600682 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-e2be421c-5a59-467f-836d-d3f9411aee64 req-1837a786-7786-43bf-bd83-c506b354ccd6 service nova] Lock "d26dc4db-d71c-43b9-811a-d39b111be119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:04.601164 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-e2be421c-5a59-467f-836d-d3f9411aee64 req-1837a786-7786-43bf-bd83-c506b354ccd6 service nova] Lock "d26dc4db-d71c-43b9-811a-d39b111be119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:04.601164 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-e2be421c-5a59-467f-836d-d3f9411aee64 req-1837a786-7786-43bf-bd83-c506b354ccd6 service nova] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] No event matching network-vif-unplugged-7d9b0e94-555b-490b-a3bc-898d6821b394 in dict_keys([('network-vif-plugged', '7d9b0e94-555b-490b-a3bc-898d6821b394')]) {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 26 10:37:04.601164 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-e2be421c-5a59-467f-836d-d3f9411aee64 req-1837a786-7786-43bf-bd83-c506b354ccd6 service nova] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Received unexpected event network-vif-unplugged-7d9b0e94-555b-490b-a3bc-898d6821b394 for instance with vm_state building and task_state spawning. Jun 26 10:37:04.611185 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98967) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 10:37:04.612213 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.lightos [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Current host hostNQN and IP(s) are ['10.4.3.79', 'fe80::f816:3eff:fe55:ba34', '192.168.40.6', 'fe80::f816:3eff:fe6b:fe1a', '192.168.50.6', 'fe80::f816:3eff:feca:9cd0', '192.168.10.6', 'fe80::f816:3eff:feb4:4e78', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f8bb:38ff:fe28:ff4a', 'fe80::fc16:3eff:fe43:69d4', 'fe80::fc16:3eff:fe4c:ec5e', 'fe80::145f:fdff:fe70:e392', 'fe80::1cb1:31ff:fe57:6a2', 'fe80::fc16:3eff:fe56:c774', 'fe80::a4ca:b5ff:fe12:2c3c'] Jun 26 10:37:04.627507 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 10:37:04.627507 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] LIGHTOS: no hostnqn found. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 10:37:04.627507 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] <== get_connector_properties: return (82ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.79', 'host': 'np0000003731', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:2fddcc2116d6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '7f2a0776-2f14-4357-a22e-baa6677eb22e', 'nvme_native_multipath': False} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:37:04.627507 np0000003731 nova-compute[98967]: DEBUG nova.virt.block_device [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Updating existing volume attachment record: 570758da-7bc1-46ae-a665-a1f9ab065a4e {{(pid=98967) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 26 10:37:04.720950 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-ea5bb605-41f2-4c3e-9b1d-31d367033511 req-35a55e01-d5cc-4e2d-b7eb-58cd113a71a0 service nova] Releasing lock "refresh_cache-64a636b4-e106-4968-8740-9938e9b2bcc8" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:04.721671 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquired lock "refresh_cache-64a636b4-e106-4968-8740-9938e9b2bcc8" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:04.730854 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:37:04.797368 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Successfully created port: 6055bbc4-aeb1-4b68-a104-fd89f90067cf {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:37:04.930792 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Start building block device mappings for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 26 10:37:05.004608 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:05.004608 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:05.006346 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98967) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 26 10:37:05.006407 np0000003731 nova-compute[98967]: INFO nova.compute.claims [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Claim successful on node np0000003731 Jun 26 10:37:05.097459 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:05.098853 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Paused> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:05.098968 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c43215aa-be15-4556-8162-bcd9793048c0] VM Paused (Lifecycle Event) Jun 26 10:37:05.210275 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Calling os-brick to attach iSCSI Volume {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 26 10:37:05.210275 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb', 'iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:37:05.211099 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:37:05.214192 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:37:05.214822 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb', 'iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 10:37:05.229614 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:37:05.230604 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:37:05.231061 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:37:05.231509 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:37:05.237836 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.004s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:37:05.237836 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:37:05.246666 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:37:05.246666 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:05.250259 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:37:05.250259 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:05.257730 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb] added Jun 26 10:37:05.257730 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:37:05.257730 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:37:05.257730 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:37:05.257730 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:37:05.257730 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:37:05.257730 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:05.258595 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:37:05.258826 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0275(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:37:05.258983 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:37:05.259095 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:05.259231 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:05.259333 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No VIF found with MAC fa:16:3e:37:b3:f6, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:37:05.259832 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Using config drive Jun 26 10:37:05.261167 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:05.264205 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb] added Jun 26 10:37:05.264205 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:37:05.264205 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:37:05.264205 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:37:05.264205 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:37:05.264205 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:37:05.264205 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:05.264779 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:37:05.264779 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0299(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:37:05.264779 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:37:05.314099 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:37:05.411923 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-2ef8bed1-5431-4b21-817c-cbb5047597ff req-d0622071-2282-4e99-a7ca-3f17e281eb1c service nova] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Received event network-vif-plugged-85e3464e-eadb-4a6d-b3b5-073945346160 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:05.412304 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-2ef8bed1-5431-4b21-817c-cbb5047597ff req-d0622071-2282-4e99-a7ca-3f17e281eb1c service nova] Acquiring lock "c43215aa-be15-4556-8162-bcd9793048c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:05.412436 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-2ef8bed1-5431-4b21-817c-cbb5047597ff req-d0622071-2282-4e99-a7ca-3f17e281eb1c service nova] Lock "c43215aa-be15-4556-8162-bcd9793048c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:05.412624 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-2ef8bed1-5431-4b21-817c-cbb5047597ff req-d0622071-2282-4e99-a7ca-3f17e281eb1c service nova] Lock "c43215aa-be15-4556-8162-bcd9793048c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:05.419614 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-2ef8bed1-5431-4b21-817c-cbb5047597ff req-d0622071-2282-4e99-a7ca-3f17e281eb1c service nova] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Processing event network-vif-plugged-85e3464e-eadb-4a6d-b3b5-073945346160 {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:37:05.419614 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-2ef8bed1-5431-4b21-817c-cbb5047597ff req-d0622071-2282-4e99-a7ca-3f17e281eb1c service nova] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Received event network-vif-plugged-85e3464e-eadb-4a6d-b3b5-073945346160 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:05.419614 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-2ef8bed1-5431-4b21-817c-cbb5047597ff req-d0622071-2282-4e99-a7ca-3f17e281eb1c service nova] Acquiring lock "c43215aa-be15-4556-8162-bcd9793048c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:05.419614 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-2ef8bed1-5431-4b21-817c-cbb5047597ff req-d0622071-2282-4e99-a7ca-3f17e281eb1c service nova] Lock "c43215aa-be15-4556-8162-bcd9793048c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:05.419614 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-2ef8bed1-5431-4b21-817c-cbb5047597ff req-d0622071-2282-4e99-a7ca-3f17e281eb1c service nova] Lock "c43215aa-be15-4556-8162-bcd9793048c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:05.419614 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-2ef8bed1-5431-4b21-817c-cbb5047597ff req-d0622071-2282-4e99-a7ca-3f17e281eb1c service nova] [instance: c43215aa-be15-4556-8162-bcd9793048c0] No waiting events found dispatching network-vif-plugged-85e3464e-eadb-4a6d-b3b5-073945346160 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:37:05.419614 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-2ef8bed1-5431-4b21-817c-cbb5047597ff req-d0622071-2282-4e99-a7ca-3f17e281eb1c service nova] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Received unexpected event network-vif-plugged-85e3464e-eadb-4a6d-b3b5-073945346160 for instance with vm_state building and task_state spawning. Jun 26 10:37:05.419614 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:37:05.419614 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Guest created on hypervisor {{(pid=98967) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 26 10:37:05.421555 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Instance spawned successfully. Jun 26 10:37:05.421911 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Attempting to register defaults for the following image properties: ['hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 26 10:37:05.423727 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Found default for hw_input_bus of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:05.423930 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Found default for hw_pointer_model of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:05.424238 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Found default for hw_video_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:05.424660 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Found default for hw_vif_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:05.469986 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:05.470111 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:05.470198 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] No VIF found with MAC fa:16:3e:f2:01:1a, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:37:05.470651 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Using config drive Jun 26 10:37:05.601156 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:05.605334 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:05.607252 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:05.607449 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c43215aa-be15-4556-8162-bcd9793048c0] VM Resumed (Lifecycle Event) Jun 26 10:37:05.768035 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:05.872261 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Updating instance_info_cache with network_info: [{"id": "2608654f-5761-4d82-a2ab-2a67e20a1c08", "address": "fa:16:3e:4b:6e:75", "network": {"id": "ee9d6726-90f0-4fdf-978b-d97dc4dc243d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1209858046-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b4242a2b73cf4564ac8f9f2cb9c7a7bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2608654f-57", "ovs_interfaceid": "2608654f-5761-4d82-a2ab-2a67e20a1c08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:05.876303 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Successfully updated port: 6055bbc4-aeb1-4b68-a104-fd89f90067cf {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:37:05.915191 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Creating config drive at /opt/stack/data/nova/instances/d26dc4db-d71c-43b9-811a-d39b111be119/disk.config Jun 26 10:37:05.918391 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/d26dc4db-d71c-43b9-811a-d39b111be119/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxddthp_h {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:05.934183 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Took 7.74 seconds to spawn the instance on the hypervisor. Jun 26 10:37:05.934183 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:05.949794 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Start spawning the instance on the hypervisor. {{(pid=98967) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 26 10:37:05.952794 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Creating instance directory {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 26 10:37:05.954510 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Creating image(s) Jun 26 10:37:05.955605 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Acquiring lock "/opt/stack/data/nova/instances/5bc6474f-1a05-4e8a-9553-a5597c60728d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:05.955841 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Lock "/opt/stack/data/nova/instances/5bc6474f-1a05-4e8a-9553-a5597c60728d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:05.956344 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/d26dc4db-d71c-43b9-811a-d39b111be119/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpxddthp_h" returned: 0 in 0.038s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:05.965223 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Lock "/opt/stack/data/nova/instances/5bc6474f-1a05-4e8a-9553-a5597c60728d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.006s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:05.965223 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7e2857eb-d7d0-425a-9e43-54800434086d req-f39a3e87-8de8-4155-9d31-c3874a3b4aa3 service nova] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Received event network-changed-6055bbc4-aeb1-4b68-a104-fd89f90067cf {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:05.965223 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7e2857eb-d7d0-425a-9e43-54800434086d req-f39a3e87-8de8-4155-9d31-c3874a3b4aa3 service nova] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Refreshing instance network info cache due to event network-changed-6055bbc4-aeb1-4b68-a104-fd89f90067cf. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:37:05.965223 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7e2857eb-d7d0-425a-9e43-54800434086d req-f39a3e87-8de8-4155-9d31-c3874a3b4aa3 service nova] Acquiring lock "refresh_cache-5bc6474f-1a05-4e8a-9553-a5597c60728d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:05.965223 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7e2857eb-d7d0-425a-9e43-54800434086d req-f39a3e87-8de8-4155-9d31-c3874a3b4aa3 service nova] Acquired lock "refresh_cache-5bc6474f-1a05-4e8a-9553-a5597c60728d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:05.965223 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-7e2857eb-d7d0-425a-9e43-54800434086d req-f39a3e87-8de8-4155-9d31-c3874a3b4aa3 service nova] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Refreshing network info cache for port 6055bbc4-aeb1-4b68-a104-fd89f90067cf {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:37:05.968220 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:05.978706 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:05.979981 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:05.985719 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:06.072518 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.087s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:06.072955 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Acquiring lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:06.073386 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:06.073842 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:06.077682 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:06.078795 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:06.111621 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:06.112741 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:37:06.155627 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.077s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:06.157499 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/5bc6474f-1a05-4e8a-9553-a5597c60728d/disk 1073741824 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:06.202747 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Creating config drive at /opt/stack/data/nova/instances/0b93909a-db10-4b65-b5a7-0aa3f0a47da7/disk.config Jun 26 10:37:06.203894 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/5bc6474f-1a05-4e8a-9553-a5597c60728d/disk 1073741824" returned: 0 in 0.046s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:06.205128 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.131s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:06.205128 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:06.234733 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0b93909a-db10-4b65-b5a7-0aa3f0a47da7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprphrgkro {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:06.259847 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:37:06.263330 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0b93909a-db10-4b65-b5a7-0aa3f0a47da7/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmprphrgkro" returned: 0 in 0.035s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:06.270689 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.40.100 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:37:06.280558 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.50.100 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:37:06.285774 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:06.289540 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.081s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:06.289540 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Checking if we can resize image /opt/stack/data/nova/instances/5bc6474f-1a05-4e8a-9553-a5597c60728d/disk. size=1073741824 {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 26 10:37:06.289540 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc6474f-1a05-4e8a-9553-a5597c60728d/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:06.308909 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:06.309757 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:06.324397 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:06.324397 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:06.324397 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:06.324592 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:06.324592 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:06.324592 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:06.333946 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:06.333946 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:06.333946 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:06.333946 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:06.333946 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:06.333946 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:06.357822 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb, portal: 192.168.50.100,3260] Jun 26 10:37:06.357822 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb, portal: 192.168.50.100,3260] successful. Jun 26 10:37:06.357822 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:06.363263 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc6474f-1a05-4e8a-9553-a5597c60728d/disk --force-share --output=json" returned: 0 in 0.076s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:06.363864 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Cannot resize image /opt/stack/data/nova/instances/5bc6474f-1a05-4e8a-9553-a5597c60728d/disk to a smaller size. {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 26 10:37:06.364533 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Created local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 26 10:37:06.364807 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Ensure instance console log exists: /opt/stack/data/nova/instances/5bc6474f-1a05-4e8a-9553-a5597c60728d/console.log {{(pid=98967) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 26 10:37:06.365230 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:06.365501 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:06.366001 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:06.370375 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:06.378856 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Releasing lock "refresh_cache-64a636b4-e106-4968-8740-9938e9b2bcc8" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:06.378856 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Instance network_info: |[{"id": "2608654f-5761-4d82-a2ab-2a67e20a1c08", "address": "fa:16:3e:4b:6e:75", "network": {"id": "ee9d6726-90f0-4fdf-978b-d97dc4dc243d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1209858046-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b4242a2b73cf4564ac8f9f2cb9c7a7bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2608654f-57", "ovs_interfaceid": "2608654f-5761-4d82-a2ab-2a67e20a1c08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 26 10:37:06.379313 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Acquiring lock "refresh_cache-5bc6474f-1a05-4e8a-9553-a5597c60728d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:06.382064 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Start _get_guest_xml network_info=[{"id": "2608654f-5761-4d82-a2ab-2a67e20a1c08", "address": "fa:16:3e:4b:6e:75", "network": {"id": "ee9d6726-90f0-4fdf-978b-d97dc4dc243d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1209858046-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b4242a2b73cf4564ac8f9f2cb9c7a7bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2608654f-57", "ovs_interfaceid": "2608654f-5761-4d82-a2ab-2a67e20a1c08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'image_id': 'a9b18127-6fee-4ed6-b364-a2d634ecb8b7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:37:06.385239 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb, portal: 192.168.40.100,3260] Jun 26 10:37:06.385239 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb, portal: 192.168.40.100,3260] successful. Jun 26 10:37:06.385239 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:06.385815 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:06.385815 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:06.385815 np0000003731 nova-compute[98967]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb (non-flash) Jun 26 10:37:06.385815 np0000003731 nova-compute[98967]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb (non-flash) Jun 26 10:37:06.385815 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:06.386153 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:06.386153 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:06.386153 np0000003731 nova-compute[98967]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb (non-flash) Jun 26 10:37:06.386153 np0000003731 nova-compute[98967]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb (non-flash) Jun 26 10:37:06.386153 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:06.387075 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.152s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:37:06.387277 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Connected to 192.168.50.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:37:06.394900 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] HCTL ('9', '-', '-', 0) found on session 4 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:37:06.394900 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:37:06.400819 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:06.401753 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:37:06.411368 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='tempest-TestMultiAttachVolumeSwap-server-574467017-2', uuid='64a636b4-e106-4968-8740-9938e9b2bcc8'), owner=OwnerMeta(userid='969d94ff13fa470c8c07bc5e419d3e13', username='tempest-TestMultiAttachVolumeSwap-1408323251-project-member', projectid='b4242a2b73cf4564ac8f9f2cb9c7a7bf', projectname='tempest-TestMultiAttachVolumeSwap-1408323251'), image=ImageMeta(id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "2608654f-5761-4d82-a2ab-2a67e20a1c08", "address": "fa:16:3e:4b:6e:75", "network": {"id": "ee9d6726-90f0-4fdf-978b-d97dc4dc243d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1209858046-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b4242a2b73cf4564ac8f9f2cb9c7a7bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2608654f-57", "ovs_interfaceid": "2608654f-5761-4d82-a2ab-2a67e20a1c08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470226.40292) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:37:06.411368 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:37:06.411368 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:37:06.411368 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:37:06.411368 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:37:06.412108 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:37:06.412573 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:37:06.412677 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:37:06.412812 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:37:06.412938 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:37:06.416340 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:37:06.418385 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:37:06.419835 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:37:06.420425 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:37:06.420746 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:37:06.420810 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:37:06.420922 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:37:06.426720 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:06.426720 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:06.426720 np0000003731 nova-compute[98967]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb (non-flash) Jun 26 10:37:06.426720 np0000003731 nova-compute[98967]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb (non-flash) Jun 26 10:37:06.426720 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:06.426928 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:06.426928 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:06.426928 np0000003731 nova-compute[98967]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb (non-flash) Jun 26 10:37:06.426928 np0000003731 nova-compute[98967]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb (non-flash) Jun 26 10:37:06.426928 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:06.428383 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.196s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:37:06.428383 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Connected to 192.168.40.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:37:06.431922 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Searching for a device in session 4 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:37:06.432173 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:37:06.433021 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] HCTL ('10', '-', '-', 0) found on session 5 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:37:06.433191 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:37:06.437176 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-574467017-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-testmultiattachvolumeswap-server-574467017-2',id=6,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSbRbM1YJq9Ia0wxRJgshSkjCUzmlOfS3KQV3f22/KUIjk7ds3Wz4HXS6ODe9kZD4ztp/Tqp7VDqOLvvsbyqTpmrjlrWC9hHWD73OsN3TnhrYQef72rYY9KvkUUZJbIrA==',key_name='tempest-keypair-932697520',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4242a2b73cf4564ac8f9f2cb9c7a7bf',ramdisk_id='',reservation_id='r-rdkz1jh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1408323251',owner_user_name='tempest-TestMultiAttachVolumeSwap-1408323251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='969d94ff13fa470c8c07bc5e419d3e13',uuid=64a636b4-e106-4968-8740-9938e9b2bcc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2608654f-5761-4d82-a2ab-2a67e20a1c08", "address": "fa:16:3e:4b:6e:75", "network": {"id": "ee9d6726-90f0-4fdf-978b-d97dc4dc243d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1209858046-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b4242a2b73cf4564ac8f9f2cb9c7a7bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2608654f-57", "ovs_interfaceid": "2608654f-5761-4d82-a2ab-2a67e20a1c08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:37:06.437591 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Converting VIF {"id": "2608654f-5761-4d82-a2ab-2a67e20a1c08", "address": "fa:16:3e:4b:6e:75", "network": {"id": "ee9d6726-90f0-4fdf-978b-d97dc4dc243d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1209858046-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b4242a2b73cf4564ac8f9f2cb9c7a7bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2608654f-57", "ovs_interfaceid": "2608654f-5761-4d82-a2ab-2a67e20a1c08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:06.439353 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:6e:75,bridge_name='br-int',has_traffic_filtering=True,id=2608654f-5761-4d82-a2ab-2a67e20a1c08,network=Network(ee9d6726-90f0-4fdf-978b-d97dc4dc243d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2608654f-57') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:06.439590 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lazy-loading 'pci_devices' on Instance uuid 64a636b4-e106-4968-8740-9938e9b2bcc8 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:37:06.463194 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Searching for a device in session 5 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:37:06.463194 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:37:06.467024 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Took 14.78 seconds to build instance. Jun 26 10:37:06.472714 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-7e2857eb-d7d0-425a-9e43-54800434086d req-f39a3e87-8de8-4155-9d31-c3874a3b4aa3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:06.589421 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-7e2857eb-d7d0-425a-9e43-54800434086d req-f39a3e87-8de8-4155-9d31-c3874a3b4aa3 service nova] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:37:06.631059 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:37:06.631059 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:37:06.637364 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:06.668952 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:06.673300 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:06.823086 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-7e2857eb-d7d0-425a-9e43-54800434086d req-f39a3e87-8de8-4155-9d31-c3874a3b4aa3 service nova] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:06.877658 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-8cf789fd-4b47-49f4-858e-a6ccad90c8dc req-acffa6eb-ba23-4c6e-9115-aa744a53e240 service nova] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Received event network-vif-plugged-7d9b0e94-555b-490b-a3bc-898d6821b394 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:06.878043 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-8cf789fd-4b47-49f4-858e-a6ccad90c8dc req-acffa6eb-ba23-4c6e-9115-aa744a53e240 service nova] Acquiring lock "d26dc4db-d71c-43b9-811a-d39b111be119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:06.878136 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-8cf789fd-4b47-49f4-858e-a6ccad90c8dc req-acffa6eb-ba23-4c6e-9115-aa744a53e240 service nova] Lock "d26dc4db-d71c-43b9-811a-d39b111be119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:06.878252 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-8cf789fd-4b47-49f4-858e-a6ccad90c8dc req-acffa6eb-ba23-4c6e-9115-aa744a53e240 service nova] Lock "d26dc4db-d71c-43b9-811a-d39b111be119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:06.878377 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-8cf789fd-4b47-49f4-858e-a6ccad90c8dc req-acffa6eb-ba23-4c6e-9115-aa744a53e240 service nova] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Processing event network-vif-plugged-7d9b0e94-555b-490b-a3bc-898d6821b394 {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:37:06.889064 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] End _get_guest_xml xml= Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: 64a636b4-e106-4968-8740-9938e9b2bcc8 Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: instance-00000006 Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: 196608 Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: tempest-TestMultiAttachVolumeSwap-server-574467017-2 Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: 2026-06-26 10:37:06 Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: 192 Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: True Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: bare Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: virtio Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: tempest-TestMultiAttachVolumeSwap-1408323251-project-member Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: tempest-TestMultiAttachVolumeSwap-1408323251 Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: 64a636b4-e106-4968-8740-9938e9b2bcc8 Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: 64a636b4-e106-4968-8740-9938e9b2bcc8 Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: hvm Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: 128 Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Preparing to wait for external event network-vif-plugged-2608654f-5761-4d82-a2ab-2a67e20a1c08 {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:37:06.947680 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "64a636b4-e106-4968-8740-9938e9b2bcc8-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:06.955100 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "64a636b4-e106-4968-8740-9938e9b2bcc8-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:06.955100 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "64a636b4-e106-4968-8740-9938e9b2bcc8-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:06.955100 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-574467017-2',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-testmultiattachvolumeswap-server-574467017-2',id=6,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSbRbM1YJq9Ia0wxRJgshSkjCUzmlOfS3KQV3f22/KUIjk7ds3Wz4HXS6ODe9kZD4ztp/Tqp7VDqOLvvsbyqTpmrjlrWC9hHWD73OsN3TnhrYQef72rYY9KvkUUZJbIrA==',key_name='tempest-keypair-932697520',keypairs=KeyPairList,launch_index=1,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='b4242a2b73cf4564ac8f9f2cb9c7a7bf',ramdisk_id='',reservation_id='r-rdkz1jh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TestMultiAttachVolumeSwap-1408323251',owner_user_name='tempest-TestMultiAttachVolumeSwap-1408323251-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:02Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='969d94ff13fa470c8c07bc5e419d3e13',uuid=64a636b4-e106-4968-8740-9938e9b2bcc8,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "2608654f-5761-4d82-a2ab-2a67e20a1c08", "address": "fa:16:3e:4b:6e:75", "network": {"id": "ee9d6726-90f0-4fdf-978b-d97dc4dc243d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1209858046-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b4242a2b73cf4564ac8f9f2cb9c7a7bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2608654f-57", "ovs_interfaceid": "2608654f-5761-4d82-a2ab-2a67e20a1c08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:37:06.955893 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Converting VIF {"id": "2608654f-5761-4d82-a2ab-2a67e20a1c08", "address": "fa:16:3e:4b:6e:75", "network": {"id": "ee9d6726-90f0-4fdf-978b-d97dc4dc243d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1209858046-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b4242a2b73cf4564ac8f9f2cb9c7a7bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2608654f-57", "ovs_interfaceid": "2608654f-5761-4d82-a2ab-2a67e20a1c08", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:06.955893 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4b:6e:75,bridge_name='br-int',has_traffic_filtering=True,id=2608654f-5761-4d82-a2ab-2a67e20a1c08,network=Network(ee9d6726-90f0-4fdf-978b-d97dc4dc243d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2608654f-57') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:06.955893 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:6e:75,bridge_name='br-int',has_traffic_filtering=True,id=2608654f-5761-4d82-a2ab-2a67e20a1c08,network=Network(ee9d6726-90f0-4fdf-978b-d97dc4dc243d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2608654f-57') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:37:06.955893 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:06.955893 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:06.955893 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:37:06.955893 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:06.955893 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '9215167b-a1f7-5b6d-a6e3-3f353c48bd0b', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:06.955893 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:06.955893 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:06.965724 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:06.969299 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:06.969439 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap2608654f-57, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:06.969791 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap2608654f-57, col_values=(('qos', UUID('56b2b1f2-453e-4f6d-9925-654a1ddbf1de')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:06.969940 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap2608654f-57, col_values=(('external_ids', {'iface-id': '2608654f-5761-4d82-a2ab-2a67e20a1c08', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4b:6e:75', 'vm-uuid': '64a636b4-e106-4968-8740-9938e9b2bcc8'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:06.970726 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:06.972301 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:06.972954 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "c43215aa-be15-4556-8162-bcd9793048c0" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 16.291s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:06.981549 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:06.983061 np0000003731 nova-compute[98967]: INFO os_vif [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4b:6e:75,bridge_name='br-int',has_traffic_filtering=True,id=2608654f-5761-4d82-a2ab-2a67e20a1c08,network=Network(ee9d6726-90f0-4fdf-978b-d97dc4dc243d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2608654f-57') Jun 26 10:37:07.023215 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:07.035885 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:07.040194 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:07.070057 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:07.084189 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:07.135424 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:37:07.157411 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:07.186720 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:07.237622 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 26 10:37:07.293119 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:07.325256 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7e2857eb-d7d0-425a-9e43-54800434086d req-f39a3e87-8de8-4155-9d31-c3874a3b4aa3 service nova] Releasing lock "refresh_cache-5bc6474f-1a05-4e8a-9553-a5597c60728d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:07.325833 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Acquired lock "refresh_cache-5bc6474f-1a05-4e8a-9553-a5597c60728d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:07.326127 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:37:07.353308 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:07.544993 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:07.564925 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:07.569269 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:07.580259 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:07.607330 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:07.622870 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:07.646319 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.643s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:07.646780 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Start building networks asynchronously for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 26 10:37:07.889162 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:37:08.093965 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:08.153199 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Allocating IP information in the background. {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 26 10:37:08.153597 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] allocate_for_instance() {{(pid=98967) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 26 10:37:08.153989 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:08.154242 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:08.262767 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Found WWN 330000000ebd9ab8b for multipath device dm-3 {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 26 10:37:08.263141 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.052s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:37:08.263507 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] <== connect_volume: return (3052ms) {'type': 'block', 'scsi_wwn': '330000000ebd9ab8b', 'path': '/dev/dm-3', 'multipath_id': '330000000ebd9ab8b'} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:37:08.263671 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ebd9ab8b', 'path': '/dev/dm-3', 'multipath_id': '330000000ebd9ab8b'} {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 26 10:37:08.278520 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lazy-loading 'flavor' on Instance uuid d48c4183-618a-4abc-9d4c-956576c74490 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:37:08.330161 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Updating instance_info_cache with network_info: [{"id": "6055bbc4-aeb1-4b68-a104-fd89f90067cf", "address": "fa:16:3e:3a:ec:e4", "network": {"id": "6a21b76b-0047-4efe-ae27-7a07d157c13a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1520786875-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f006893b34fb45e7bf33415299ffc934", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6055bbc4-ae", "ovs_interfaceid": "6055bbc4-aeb1-4b68-a104-fd89f90067cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:08.518953 np0000003731 nova-compute[98967]: DEBUG nova.policy [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8a089dde66194b5b967cb79918aa1a33', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93df6885279b4537969fc0d1beb9f198', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98967) authorize /opt/stack/nova/nova/policy.py:192}} Jun 26 10:37:08.533957 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:08.534286 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:08.534465 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] No VIF found with MAC fa:16:3e:4b:6e:75, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:37:08.535089 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Using config drive Jun 26 10:37:08.568938 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:37:08.570158 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:08.570689 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] VM Started (Lifecycle Event) Jun 26 10:37:08.571686 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Guest created on hypervisor {{(pid=98967) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 26 10:37:08.573818 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Instance spawned successfully. Jun 26 10:37:08.574170 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 26 10:37:08.608283 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-a917832c-c801-4ddd-83f9-add52dc0450c req-0fdb01ac-d7cc-4f4a-85f0-43dab3a502ef service nova] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Received event network-changed-85e3464e-eadb-4a6d-b3b5-073945346160 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:08.608283 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-a917832c-c801-4ddd-83f9-add52dc0450c req-0fdb01ac-d7cc-4f4a-85f0-43dab3a502ef service nova] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Refreshing instance network info cache due to event network-changed-85e3464e-eadb-4a6d-b3b5-073945346160. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:37:08.608283 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-a917832c-c801-4ddd-83f9-add52dc0450c req-0fdb01ac-d7cc-4f4a-85f0-43dab3a502ef service nova] Acquiring lock "refresh_cache-c43215aa-be15-4556-8162-bcd9793048c0" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:08.608283 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-a917832c-c801-4ddd-83f9-add52dc0450c req-0fdb01ac-d7cc-4f4a-85f0-43dab3a502ef service nova] Acquired lock "refresh_cache-c43215aa-be15-4556-8162-bcd9793048c0" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:08.608283 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-a917832c-c801-4ddd-83f9-add52dc0450c req-0fdb01ac-d7cc-4f4a-85f0-43dab3a502ef service nova] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Refreshing network info cache for port 85e3464e-eadb-4a6d-b3b5-073945346160 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:37:08.662031 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 26 10:37:08.782654 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Attempting to attach volume b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98967) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 26 10:37:08.790150 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] attach device xml: Jun 26 10:37:08.790150 np0000003731 nova-compute[98967]: Jun 26 10:37:08.790150 np0000003731 nova-compute[98967]: Jun 26 10:37:08.790150 np0000003731 nova-compute[98967]: Jun 26 10:37:08.790150 np0000003731 nova-compute[98967]: Jun 26 10:37:08.790150 np0000003731 nova-compute[98967]: b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb Jun 26 10:37:08.790150 np0000003731 nova-compute[98967]: Jun 26 10:37:08.790150 np0000003731 nova-compute[98967]: {{(pid=98967) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 26 10:37:08.833270 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Releasing lock "refresh_cache-5bc6474f-1a05-4e8a-9553-a5597c60728d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:08.833578 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Instance network_info: |[{"id": "6055bbc4-aeb1-4b68-a104-fd89f90067cf", "address": "fa:16:3e:3a:ec:e4", "network": {"id": "6a21b76b-0047-4efe-ae27-7a07d157c13a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1520786875-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f006893b34fb45e7bf33415299ffc934", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6055bbc4-ae", "ovs_interfaceid": "6055bbc4-aeb1-4b68-a104-fd89f90067cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 26 10:37:08.838668 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Start _get_guest_xml network_info=[{"id": "6055bbc4-aeb1-4b68-a104-fd89f90067cf", "address": "fa:16:3e:3a:ec:e4", "network": {"id": "6a21b76b-0047-4efe-ae27-7a07d157c13a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1520786875-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f006893b34fb45e7bf33415299ffc934", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6055bbc4-ae", "ovs_interfaceid": "6055bbc4-aeb1-4b68-a104-fd89f90067cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'image_id': 'a9b18127-6fee-4ed6-b364-a2d634ecb8b7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:37:08.841771 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:37:08.841771 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='tempest-VolumesAssistedSnapshotsTest-server-1386405030', uuid='5bc6474f-1a05-4e8a-9553-a5597c60728d'), owner=OwnerMeta(userid='93b18ad8fd1549ebbb429c95feb252b2', username='tempest-VolumesAssistedSnapshotsTest-736988545-project-member', projectid='f006893b34fb45e7bf33415299ffc934', projectname='tempest-VolumesAssistedSnapshotsTest-736988545'), image=ImageMeta(id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "6055bbc4-aeb1-4b68-a104-fd89f90067cf", "address": "fa:16:3e:3a:ec:e4", "network": {"id": "6a21b76b-0047-4efe-ae27-7a07d157c13a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1520786875-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f006893b34fb45e7bf33415299ffc934", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6055bbc4-ae", "ovs_interfaceid": "6055bbc4-aeb1-4b68-a104-fd89f90067cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470228.8413754) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:37:08.843382 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:37:08.843382 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:37:08.847024 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:37:08.847024 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:37:08.847024 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:37:08.847024 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:37:08.847024 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:37:08.847024 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:37:08.847024 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:37:08.847024 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:37:08.847024 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:37:08.847024 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:37:08.847024 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:37:08.847024 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:37:08.847024 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:37:08.847024 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:37:08.858025 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:36:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1386405030',display_name='tempest-VolumesAssistedSnapshotsTest-server-1386405030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-volumesassistedsnapshotstest-server-1386405030',id=7,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnHGWwEuXEhb1IzOgp8fDn85bj3sm3mK8KShUXLtm9TNgLS8Zo/JVq6sJuJKzUT1WkRlLE7Tnw+cZP4cweT/ZA/DmDNEjbD6ObFV3UAJh5f4VY6CfXeWw0bOU2RuINXtA==',key_name='tempest-keypair-1500016376',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f006893b34fb45e7bf33415299ffc934',ramdisk_id='',reservation_id='r-otdaw6r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-736988545',owner_user_name='tempest-VolumesAssistedSnapshotsTest-736988545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93b18ad8fd1549ebbb429c95feb252b2',uuid=5bc6474f-1a05-4e8a-9553-a5597c60728d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6055bbc4-aeb1-4b68-a104-fd89f90067cf", "address": "fa:16:3e:3a:ec:e4", "network": {"id": "6a21b76b-0047-4efe-ae27-7a07d157c13a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1520786875-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f006893b34fb45e7bf33415299ffc934", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6055bbc4-ae", "ovs_interfaceid": "6055bbc4-aeb1-4b68-a104-fd89f90067cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:37:08.858520 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Converting VIF {"id": "6055bbc4-aeb1-4b68-a104-fd89f90067cf", "address": "fa:16:3e:3a:ec:e4", "network": {"id": "6a21b76b-0047-4efe-ae27-7a07d157c13a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1520786875-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f006893b34fb45e7bf33415299ffc934", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6055bbc4-ae", "ovs_interfaceid": "6055bbc4-aeb1-4b68-a104-fd89f90067cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:08.859207 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ec:e4,bridge_name='br-int',has_traffic_filtering=True,id=6055bbc4-aeb1-4b68-a104-fd89f90067cf,network=Network(6a21b76b-0047-4efe-ae27-7a07d157c13a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6055bbc4-ae') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:08.859820 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Lazy-loading 'pci_devices' on Instance uuid 5bc6474f-1a05-4e8a-9553-a5597c60728d {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:37:09.005258 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-2e5fdaa9-89c1-4395-a3ea-ccd89f5f7070 req-f684be27-5a34-4f4a-af0d-1446c19401be service nova] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Received event network-vif-plugged-7d9b0e94-555b-490b-a3bc-898d6821b394 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:09.008253 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-2e5fdaa9-89c1-4395-a3ea-ccd89f5f7070 req-f684be27-5a34-4f4a-af0d-1446c19401be service nova] Acquiring lock "d26dc4db-d71c-43b9-811a-d39b111be119-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:09.008633 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-2e5fdaa9-89c1-4395-a3ea-ccd89f5f7070 req-f684be27-5a34-4f4a-af0d-1446c19401be service nova] Lock "d26dc4db-d71c-43b9-811a-d39b111be119-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:09.008633 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-2e5fdaa9-89c1-4395-a3ea-ccd89f5f7070 req-f684be27-5a34-4f4a-af0d-1446c19401be service nova] Lock "d26dc4db-d71c-43b9-811a-d39b111be119-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:09.008876 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-2e5fdaa9-89c1-4395-a3ea-ccd89f5f7070 req-f684be27-5a34-4f4a-af0d-1446c19401be service nova] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] No waiting events found dispatching network-vif-plugged-7d9b0e94-555b-490b-a3bc-898d6821b394 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:37:09.008947 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-2e5fdaa9-89c1-4395-a3ea-ccd89f5f7070 req-f684be27-5a34-4f4a-af0d-1446c19401be service nova] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Received unexpected event network-vif-plugged-7d9b0e94-555b-490b-a3bc-898d6821b394 for instance with vm_state building and task_state spawning. Jun 26 10:37:09.043294 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:09.073302 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:09.075607 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:37:09.088409 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Found default for hw_cdrom_bus of ide {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:09.088540 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Found default for hw_disk_bus of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:09.088806 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Found default for hw_input_bus of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:09.089002 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Found default for hw_pointer_model of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:09.089242 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Found default for hw_video_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:09.089435 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Found default for hw_vif_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:09.105929 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-a917832c-c801-4ddd-83f9-add52dc0450c req-0fdb01ac-d7cc-4f4a-85f0-43dab3a502ef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:09.214885 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Creating config drive at /opt/stack/data/nova/instances/64a636b4-e106-4968-8740-9938e9b2bcc8/disk.config Jun 26 10:37:09.220216 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/64a636b4-e106-4968-8740-9938e9b2bcc8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6ozn0e4z {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:09.253519 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/64a636b4-e106-4968-8740-9938e9b2bcc8/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6ozn0e4z" returned: 0 in 0.033s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] End _get_guest_xml xml= Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: 5bc6474f-1a05-4e8a-9553-a5597c60728d Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: instance-00000007 Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: 196608 Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: tempest-VolumesAssistedSnapshotsTest-server-1386405030 Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: 2026-06-26 10:37:08 Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: 192 Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: True Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: bare Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: virtio Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: tempest-VolumesAssistedSnapshotsTest-736988545-project-member Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: tempest-VolumesAssistedSnapshotsTest-736988545 Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: 5bc6474f-1a05-4e8a-9553-a5597c60728d Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: 5bc6474f-1a05-4e8a-9553-a5597c60728d Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: hvm Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: 128 Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Preparing to wait for external event network-vif-plugged-6055bbc4-aeb1-4b68-a104-fd89f90067cf {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Acquiring lock "5bc6474f-1a05-4e8a-9553-a5597c60728d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:09.365150 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Lock "5bc6474f-1a05-4e8a-9553-a5597c60728d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:09.367185 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Lock "5bc6474f-1a05-4e8a-9553-a5597c60728d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:09.373115 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:36:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1386405030',display_name='tempest-VolumesAssistedSnapshotsTest-server-1386405030',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-volumesassistedsnapshotstest-server-1386405030',id=7,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnHGWwEuXEhb1IzOgp8fDn85bj3sm3mK8KShUXLtm9TNgLS8Zo/JVq6sJuJKzUT1WkRlLE7Tnw+cZP4cweT/ZA/DmDNEjbD6ObFV3UAJh5f4VY6CfXeWw0bOU2RuINXtA==',key_name='tempest-keypair-1500016376',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='f006893b34fb45e7bf33415299ffc934',ramdisk_id='',reservation_id='r-otdaw6r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAssistedSnapshotsTest-736988545',owner_user_name='tempest-VolumesAssistedSnapshotsTest-736988545-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93b18ad8fd1549ebbb429c95feb252b2',uuid=5bc6474f-1a05-4e8a-9553-a5597c60728d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "6055bbc4-aeb1-4b68-a104-fd89f90067cf", "address": "fa:16:3e:3a:ec:e4", "network": {"id": "6a21b76b-0047-4efe-ae27-7a07d157c13a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1520786875-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f006893b34fb45e7bf33415299ffc934", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6055bbc4-ae", "ovs_interfaceid": "6055bbc4-aeb1-4b68-a104-fd89f90067cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:37:09.373115 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Converting VIF {"id": "6055bbc4-aeb1-4b68-a104-fd89f90067cf", "address": "fa:16:3e:3a:ec:e4", "network": {"id": "6a21b76b-0047-4efe-ae27-7a07d157c13a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1520786875-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f006893b34fb45e7bf33415299ffc934", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6055bbc4-ae", "ovs_interfaceid": "6055bbc4-aeb1-4b68-a104-fd89f90067cf", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:09.373115 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ec:e4,bridge_name='br-int',has_traffic_filtering=True,id=6055bbc4-aeb1-4b68-a104-fd89f90067cf,network=Network(6a21b76b-0047-4efe-ae27-7a07d157c13a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6055bbc4-ae') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:09.373742 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ec:e4,bridge_name='br-int',has_traffic_filtering=True,id=6055bbc4-aeb1-4b68-a104-fd89f90067cf,network=Network(6a21b76b-0047-4efe-ae27-7a07d157c13a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6055bbc4-ae') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:37:09.374584 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:09.375060 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:09.376375 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:37:09.377503 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:09.377756 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2940ef75-755f-53d9-aec4-60a030406a2d', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:09.384089 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:09.391145 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:09.394998 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:09.394998 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap6055bbc4-ae, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:09.394998 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap6055bbc4-ae, col_values=(('qos', UUID('debba016-fdcc-4a2b-9d15-ebac8a34221b')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:09.394998 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap6055bbc4-ae, col_values=(('external_ids', {'iface-id': '6055bbc4-aeb1-4b68-a104-fd89f90067cf', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:3a:ec:e4', 'vm-uuid': '5bc6474f-1a05-4e8a-9553-a5597c60728d'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:09.394998 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:09.397803 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:09.409294 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:09.410765 np0000003731 nova-compute[98967]: INFO os_vif [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:3a:ec:e4,bridge_name='br-int',has_traffic_filtering=True,id=6055bbc4-aeb1-4b68-a104-fd89f90067cf,network=Network(6a21b76b-0047-4efe-ae27-7a07d157c13a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6055bbc4-ae') Jun 26 10:37:09.422983 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Successfully created port: 38973918-1218-4531-8941-0e9fbff30e3e {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:37:09.580779 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] During sync_power_state the instance has a pending task (spawning). Skip. Jun 26 10:37:09.581018 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Paused> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:09.581127 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] VM Paused (Lifecycle Event) Jun 26 10:37:09.595429 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Took 10.99 seconds to spawn the instance on the hypervisor. Jun 26 10:37:09.595680 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:09.611876 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-a917832c-c801-4ddd-83f9-add52dc0450c req-0fdb01ac-d7cc-4f4a-85f0-43dab3a502ef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:09.773082 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:09.802387 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-a917832c-c801-4ddd-83f9-add52dc0450c req-0fdb01ac-d7cc-4f4a-85f0-43dab3a502ef service nova] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Updated VIF entry in instance network info cache for port 85e3464e-eadb-4a6d-b3b5-073945346160. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:37:09.802829 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-a917832c-c801-4ddd-83f9-add52dc0450c req-0fdb01ac-d7cc-4f4a-85f0-43dab3a502ef service nova] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Updating instance_info_cache with network_info: [{"id": "85e3464e-eadb-4a6d-b3b5-073945346160", "address": "fa:16:3e:56:c7:74", "network": {"id": "640dfe2a-db65-4dfd-a073-17ac7680d2b0", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1874770241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f37c91742d834881a1ec62e1eb1ecdcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e3464e-ea", "ovs_interfaceid": "85e3464e-eadb-4a6d-b3b5-073945346160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:09.807652 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:09.908667 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:37:09.909134 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:37:09.909398 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:37:09.909615 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:37:09.909864 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:37:09.910198 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:37:09.910363 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:37:09.910546 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98967) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 26 10:37:09.910731 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager.update_available_resource {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:37:09.931492 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:09.965657 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Successfully created port: f141a8bb-5a71-4872-b62f-9fce6052875a {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:37:09.984187 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:09.991069 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:10.085757 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:10.089207 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:10.089350 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] VM Resumed (Lifecycle Event) Jun 26 10:37:10.110761 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Took 19.35 seconds to build instance. Jun 26 10:37:10.177665 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Start building block device mappings for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 26 10:37:10.305737 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-a917832c-c801-4ddd-83f9-add52dc0450c req-0fdb01ac-d7cc-4f4a-85f0-43dab3a502ef service nova] Releasing lock "refresh_cache-c43215aa-be15-4556-8162-bcd9793048c0" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:10.415241 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:10.415716 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:10.415716 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:10.415716 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Auditing locally available compute resources for np0000003731 (node: np0000003731) {{(pid=98967) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 26 10:37:10.514784 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:10.515528 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:10.515528 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:10.515528 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] No VIF found with MAC fa:16:3e:43:69:d4, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:37:10.567251 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Successfully created port: fa54a649-79c1-4413-91b2-680216f8b045 {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:37:10.593850 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:10.595290 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: d26dc4db-d71c-43b9-811a-d39b111be119] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:37:10.613740 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4ec6b16-6f79-4658-b57f-30c3c90d9b4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "d26dc4db-d71c-43b9-811a-d39b111be119" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 20.860s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:10.683715 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-821f2234-5f56-43eb-8a01-9398c0027439 req-af53af73-007e-4598-a528-b93272f403d9 service nova] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Received event network-vif-plugged-2608654f-5761-4d82-a2ab-2a67e20a1c08 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:10.683941 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-821f2234-5f56-43eb-8a01-9398c0027439 req-af53af73-007e-4598-a528-b93272f403d9 service nova] Acquiring lock "64a636b4-e106-4968-8740-9938e9b2bcc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:10.684202 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-821f2234-5f56-43eb-8a01-9398c0027439 req-af53af73-007e-4598-a528-b93272f403d9 service nova] Lock "64a636b4-e106-4968-8740-9938e9b2bcc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:10.684686 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-821f2234-5f56-43eb-8a01-9398c0027439 req-af53af73-007e-4598-a528-b93272f403d9 service nova] Lock "64a636b4-e106-4968-8740-9938e9b2bcc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:10.685129 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-821f2234-5f56-43eb-8a01-9398c0027439 req-af53af73-007e-4598-a528-b93272f403d9 service nova] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Processing event network-vif-plugged-2608654f-5761-4d82-a2ab-2a67e20a1c08 {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:37:10.685346 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-821f2234-5f56-43eb-8a01-9398c0027439 req-af53af73-007e-4598-a528-b93272f403d9 service nova] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Received event network-vif-plugged-2608654f-5761-4d82-a2ab-2a67e20a1c08 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:10.688217 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-821f2234-5f56-43eb-8a01-9398c0027439 req-af53af73-007e-4598-a528-b93272f403d9 service nova] Acquiring lock "64a636b4-e106-4968-8740-9938e9b2bcc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:10.691575 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-821f2234-5f56-43eb-8a01-9398c0027439 req-af53af73-007e-4598-a528-b93272f403d9 service nova] Lock "64a636b4-e106-4968-8740-9938e9b2bcc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.005s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:10.691943 np0000003731 nova-compute[98967]: INFO nova.virt.block_device [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Booting with volume 3cb9f515-cb6e-4822-8208-4bd6694ad020 at /dev/vda Jun 26 10:37:10.692828 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-821f2234-5f56-43eb-8a01-9398c0027439 req-af53af73-007e-4598-a528-b93272f403d9 service nova] Lock "64a636b4-e106-4968-8740-9938e9b2bcc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:10.692991 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-821f2234-5f56-43eb-8a01-9398c0027439 req-af53af73-007e-4598-a528-b93272f403d9 service nova] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] No waiting events found dispatching network-vif-plugged-2608654f-5761-4d82-a2ab-2a67e20a1c08 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:37:10.693179 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-821f2234-5f56-43eb-8a01-9398c0027439 req-af53af73-007e-4598-a528-b93272f403d9 service nova] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Received unexpected event network-vif-plugged-2608654f-5761-4d82-a2ab-2a67e20a1c08 for instance with vm_state building and task_state spawning. Jun 26 10:37:10.752209 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.79', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003731', 'execute': None}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:37:10.766885 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.scaleio [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98967) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 10:37:10.794658 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Running cmd (subprocess): nvme version {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:10.824098 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] 'nvme version' failed. Not Retrying. {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 10:37:10.825083 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] nvme not present on system {{(pid=98967) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 10:37:10.838085 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98967) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 10:37:10.838085 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.lightos [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Current host hostNQN and IP(s) are ['10.4.3.79', 'fe80::f816:3eff:fe55:ba34', '192.168.40.6', 'fe80::f816:3eff:fe6b:fe1a', '192.168.50.6', 'fe80::f816:3eff:feca:9cd0', '192.168.10.6', 'fe80::f816:3eff:feb4:4e78', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f8bb:38ff:fe28:ff4a', 'fe80::fc16:3eff:fe43:69d4', 'fe80::fc16:3eff:fe4c:ec5e', 'fe80::145f:fdff:fe70:e392', 'fe80::1cb1:31ff:fe57:6a2', 'fe80::fc16:3eff:fe56:c774', 'fe80::a4ca:b5ff:fe12:2c3c', 'fe80::fc16:3eff:fe37:b3f6', 'fe80::41a:feff:fe02:479d', 'fe80::fc16:3eff:fef2:11a', 'fe80::a061:7eff:feb6:8085', 'fe80::fc16:3eff:fe4b:6e75'] Jun 26 10:37:10.838085 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 10:37:10.838085 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] LIGHTOS: no hostnqn found. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 10:37:10.838085 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.79', 'host': 'np0000003731', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:2fddcc2116d6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '7f2a0776-2f14-4357-a22e-baa6677eb22e', 'nvme_native_multipath': False} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:37:10.838085 np0000003731 nova-compute[98967]: DEBUG nova.virt.block_device [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Updating existing volume attachment record: d1a552ff-c3ac-4fff-b980-de2612e82e76 {{(pid=98967) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 26 10:37:10.849646 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:37:10.852532 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Guest created on hypervisor {{(pid=98967) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 26 10:37:10.854662 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Instance spawned successfully. Jun 26 10:37:10.855198 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 26 10:37:10.936934 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:10.937135 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:10.938137 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] No VIF found with MAC fa:16:3e:3a:ec:e4, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:37:10.938137 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Using config drive Jun 26 10:37:11.097945 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:11.098547 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] VM Started (Lifecycle Event) Jun 26 10:37:11.124927 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Successfully created port: 4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:37:11.364033 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Found default for hw_cdrom_bus of ide {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:11.364219 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Found default for hw_disk_bus of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:11.364867 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Found default for hw_input_bus of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:11.365220 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Found default for hw_pointer_model of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:11.366022 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Found default for hw_video_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:11.366022 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Found default for hw_vif_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:11.450695 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:11.465435 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d48c4183-618a-4abc-9d4c-956576c74490/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:11.567826 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d48c4183-618a-4abc-9d4c-956576c74490/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:11.569844 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d48c4183-618a-4abc-9d4c-956576c74490/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:11.610519 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:11.614904 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Paused> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:11.615230 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] VM Paused (Lifecycle Event) Jun 26 10:37:11.662175 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/d48c4183-618a-4abc-9d4c-956576c74490/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:11.662761 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] skipping disk /dev/dm-3 (vdb) as it is a volume {{(pid=98967) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 26 10:37:11.667684 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43215aa-be15-4556-8162-bcd9793048c0/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:11.743633 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Creating config drive at /opt/stack/data/nova/instances/5bc6474f-1a05-4e8a-9553-a5597c60728d/disk.config Jun 26 10:37:11.747732 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43215aa-be15-4556-8162-bcd9793048c0/disk --force-share --output=json" returned: 0 in 0.080s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:11.749424 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43215aa-be15-4556-8162-bcd9793048c0/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:11.766575 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Successfully created port: 53ab7bb3-88bd-4061-9d43-b6392e20c003 {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:37:11.771650 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/5bc6474f-1a05-4e8a-9553-a5597c60728d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9cf07x3o {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:11.807464 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/5bc6474f-1a05-4e8a-9553-a5597c60728d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp9cf07x3o" returned: 0 in 0.035s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:11.830449 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c43215aa-be15-4556-8162-bcd9793048c0/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:11.835752 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:11.873200 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Took 8.55 seconds to spawn the instance on the hypervisor. Jun 26 10:37:11.873384 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:11.919028 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:11.920724 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:11.993747 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d/disk --force-share --output=json" returned: 0 in 0.073s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:12.000187 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b93909a-db10-4b65-b5a7-0aa3f0a47da7/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:12.077961 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b93909a-db10-4b65-b5a7-0aa3f0a47da7/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:12.081171 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b93909a-db10-4b65-b5a7-0aa3f0a47da7/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:12.120762 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:12.128575 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c098d13a-58e4-4082-b2e1-5627eb520816 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "d48c4183-618a-4abc-9d4c-956576c74490" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.651s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:12.130680 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:37:12.170474 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b93909a-db10-4b65-b5a7-0aa3f0a47da7/disk --force-share --output=json" returned: 0 in 0.092s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:12.177050 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98967) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 26 10:37:12.186793 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64a636b4-e106-4968-8740-9938e9b2bcc8/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:12.273374 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64a636b4-e106-4968-8740-9938e9b2bcc8/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:12.273934 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64a636b4-e106-4968-8740-9938e9b2bcc8/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:12.333203 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:12.360521 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:12.370278 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Acquiring lock "d48c4183-618a-4abc-9d4c-956576c74490" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:12.370791 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "d48c4183-618a-4abc-9d4c-956576c74490" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.002s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:12.371285 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Acquiring lock "d48c4183-618a-4abc-9d4c-956576c74490-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:12.371285 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "d48c4183-618a-4abc-9d4c-956576c74490-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:12.371777 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "d48c4183-618a-4abc-9d4c-956576c74490-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:12.379141 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Terminating instance Jun 26 10:37:12.394229 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64a636b4-e106-4968-8740-9938e9b2bcc8/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:12.404559 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Took 19.95 seconds to build instance. Jun 26 10:37:12.508622 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:12.522626 np0000003731 nova-compute[98967]: INFO nova.virt.block_device [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Booting with volume 1b0b898b-40b8-40fe-84eb-0361ea0aaf77 at /dev/vdb Jun 26 10:37:12.533029 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Successfully updated port: 38973918-1218-4531-8941-0e9fbff30e3e {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:37:12.575801 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc6474f-1a05-4e8a-9553-a5597c60728d/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:12.598325 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.79', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003731', 'execute': None}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:37:12.606626 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-4d38bf49-0b99-4054-aea1-bf12705db6b0 req-ab2c2adc-5140-45ca-9507-c8083ad59d53 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-changed-38973918-1218-4531-8941-0e9fbff30e3e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:12.606626 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-4d38bf49-0b99-4054-aea1-bf12705db6b0 req-ab2c2adc-5140-45ca-9507-c8083ad59d53 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Refreshing instance network info cache due to event network-changed-38973918-1218-4531-8941-0e9fbff30e3e. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:37:12.606626 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-4d38bf49-0b99-4054-aea1-bf12705db6b0 req-ab2c2adc-5140-45ca-9507-c8083ad59d53 service nova] Acquiring lock "refresh_cache-a686feac-bebe-47c8-a3c8-f3c2260ca7f5" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:12.606626 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-4d38bf49-0b99-4054-aea1-bf12705db6b0 req-ab2c2adc-5140-45ca-9507-c8083ad59d53 service nova] Acquired lock "refresh_cache-a686feac-bebe-47c8-a3c8-f3c2260ca7f5" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:12.606626 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-4d38bf49-0b99-4054-aea1-bf12705db6b0 req-ab2c2adc-5140-45ca-9507-c8083ad59d53 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Refreshing network info cache for port 38973918-1218-4531-8941-0e9fbff30e3e {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:37:12.617197 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.scaleio [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98967) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 10:37:12.635087 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] During sync_power_state the instance has a pending task (spawning). Skip. Jun 26 10:37:12.635087 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:12.635087 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] VM Started (Lifecycle Event) Jun 26 10:37:12.648588 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Running cmd (subprocess): nvme version {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:12.670534 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc6474f-1a05-4e8a-9553-a5597c60728d/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:12.671260 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc6474f-1a05-4e8a-9553-a5597c60728d/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:12.682912 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] 'nvme version' failed. Not Retrying. {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 10:37:12.688675 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] nvme not present on system {{(pid=98967) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 10:37:12.703028 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98967) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 10:37:12.703028 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.lightos [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Current host hostNQN and IP(s) are ['10.4.3.79', 'fe80::f816:3eff:fe55:ba34', '192.168.40.6', 'fe80::f816:3eff:fe6b:fe1a', '192.168.50.6', 'fe80::f816:3eff:feca:9cd0', '192.168.10.6', 'fe80::f816:3eff:feb4:4e78', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f8bb:38ff:fe28:ff4a', 'fe80::fc16:3eff:fe43:69d4', 'fe80::fc16:3eff:fe4c:ec5e', 'fe80::145f:fdff:fe70:e392', 'fe80::1cb1:31ff:fe57:6a2', 'fe80::fc16:3eff:fe56:c774', 'fe80::a4ca:b5ff:fe12:2c3c', 'fe80::fc16:3eff:fe37:b3f6', 'fe80::41a:feff:fe02:479d', 'fe80::fc16:3eff:fef2:11a', 'fe80::a061:7eff:feb6:8085', 'fe80::fc16:3eff:fe4b:6e75', 'fe80::fc16:3eff:fe3a:ece4', 'fe80::60f0:e4ff:fe6b:bf4c'] Jun 26 10:37:12.703028 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 10:37:12.703028 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] LIGHTOS: no hostnqn found. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 10:37:12.703028 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] <== get_connector_properties: return (106ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.79', 'host': 'np0000003731', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:2fddcc2116d6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '7f2a0776-2f14-4357-a22e-baa6677eb22e', 'nvme_native_multipath': False} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:37:12.703746 np0000003731 nova-compute[98967]: DEBUG nova.virt.block_device [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Updating existing volume attachment record: bbb89cef-13ef-485b-a895-41272582206a {{(pid=98967) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 26 10:37:12.764498 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/5bc6474f-1a05-4e8a-9553-a5597c60728d/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:12.772346 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-352e01d5-970d-4670-8857-053f563b5a7a req-aed6dd04-389b-4598-ad0a-b4fc4584dc39 service nova] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Received event network-vif-plugged-6055bbc4-aeb1-4b68-a104-fd89f90067cf {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:12.772346 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-352e01d5-970d-4670-8857-053f563b5a7a req-aed6dd04-389b-4598-ad0a-b4fc4584dc39 service nova] Acquiring lock "5bc6474f-1a05-4e8a-9553-a5597c60728d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:12.772769 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-352e01d5-970d-4670-8857-053f563b5a7a req-aed6dd04-389b-4598-ad0a-b4fc4584dc39 service nova] Lock "5bc6474f-1a05-4e8a-9553-a5597c60728d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:12.773564 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-352e01d5-970d-4670-8857-053f563b5a7a req-aed6dd04-389b-4598-ad0a-b4fc4584dc39 service nova] Lock "5bc6474f-1a05-4e8a-9553-a5597c60728d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:12.774769 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-352e01d5-970d-4670-8857-053f563b5a7a req-aed6dd04-389b-4598-ad0a-b4fc4584dc39 service nova] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Processing event network-vif-plugged-6055bbc4-aeb1-4b68-a104-fd89f90067cf {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:37:12.774967 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:37:12.777473 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:12.808283 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:12.812745 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:12.813768 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "env LANG=C uptime" returned: 0 in 0.036s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:12.820383 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Hypervisor/Node resource view: name=np0000003731 free_ram=52096MB free_disk=74.62907791137695GB free_vcpus=10 pci_devices=[{"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98967) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 26 10:37:12.820718 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:12.821914 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:12.837479 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:12.838404 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:12.902917 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Start destroying the instance on the hypervisor. {{(pid=98967) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 26 10:37:12.907410 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "64a636b4-e106-4968-8740-9938e9b2bcc8" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 21.459s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:12.926214 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:12.928333 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:12.951492 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:13.000888 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:13.023329 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:13.028703 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:13.110896 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-4d38bf49-0b99-4054-aea1-bf12705db6b0 req-ab2c2adc-5140-45ca-9507-c8083ad59d53 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:13.140097 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:13.145414 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:37:13.213542 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-4d38bf49-0b99-4054-aea1-bf12705db6b0 req-ab2c2adc-5140-45ca-9507-c8083ad59d53 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:37:13.239306 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:13.289524 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Instance destroyed successfully. Jun 26 10:37:13.295642 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lazy-loading 'resources' on Instance uuid d48c4183-618a-4abc-9d4c-956576c74490 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:37:13.375866 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:13.525068 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-4d38bf49-0b99-4054-aea1-bf12705db6b0 req-ab2c2adc-5140-45ca-9507-c8083ad59d53 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:13.595767 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "4b4a4a7e-d584-427e-91d2-7d9e710ea2a3" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:13.595908 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "4b4a4a7e-d584-427e-91d2-7d9e710ea2a3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:13.633683 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:37:13.635832 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Guest created on hypervisor {{(pid=98967) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 26 10:37:13.637641 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Instance spawned successfully. Jun 26 10:37:13.638137 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 26 10:37:13.651497 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Paused> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:13.651640 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] VM Paused (Lifecycle Event) Jun 26 10:37:13.795584 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:36:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-DeleteServersTestJSON-server-812016894',display_name='tempest-DeleteServersTestJSON-server-812016894',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-deleteserverstestjson-server-812016894',id=1,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-26T10:36:59Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='acf021cccf734aff828c39edc32e8b5e',ramdisk_id='',reservation_id='r-oxk0tdw6',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-DeleteServersTestJSON-897256898',owner_user_name='tempest-DeleteServersTestJSON-897256898-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-26T10:36:59Z,user_data=None,user_id='a2ddca56c98d4cb59b505987f4d0f67c',uuid=d48c4183-618a-4abc-9d4c-956576c74490,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "354a4b12-1c99-40fe-9c24-5e9a8aa3293f", "address": "fa:16:3e:43:69:d4", "network": {"id": "1d434908-4015-4955-84bf-12c024021b3c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-679956387-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "acf021cccf734aff828c39edc32e8b5e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap354a4b12-1c", "ovs_interfaceid": "354a4b12-1c99-40fe-9c24-5e9a8aa3293f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 26 10:37:13.796526 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Converting VIF {"id": "354a4b12-1c99-40fe-9c24-5e9a8aa3293f", "address": "fa:16:3e:43:69:d4", "network": {"id": "1d434908-4015-4955-84bf-12c024021b3c", "bridge": "br-int", "label": "tempest-DeleteServersTestJSON-679956387-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "acf021cccf734aff828c39edc32e8b5e", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap354a4b12-1c", "ovs_interfaceid": "354a4b12-1c99-40fe-9c24-5e9a8aa3293f", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:13.796526 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:69:d4,bridge_name='br-int',has_traffic_filtering=True,id=354a4b12-1c99-40fe-9c24-5e9a8aa3293f,network=Network(1d434908-4015-4955-84bf-12c024021b3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap354a4b12-1c') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:13.796805 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:69:d4,bridge_name='br-int',has_traffic_filtering=True,id=354a4b12-1c99-40fe-9c24-5e9a8aa3293f,network=Network(1d434908-4015-4955-84bf-12c024021b3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap354a4b12-1c') {{(pid=98967) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 26 10:37:13.799314 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:13.799662 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap354a4b12-1c, bridge=br-int, if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:13.800828 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:13.802261 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:13.802261 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:13.804530 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:13.804715 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=c4a01483-d910-4239-86ec-bd3d9c52be04) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:13.805249 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:13.806236 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:13.807064 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:13.812496 np0000003731 nova-compute[98967]: INFO os_vif [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:69:d4,bridge_name='br-int',has_traffic_filtering=True,id=354a4b12-1c99-40fe-9c24-5e9a8aa3293f,network=Network(1d434908-4015-4955-84bf-12c024021b3c),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap354a4b12-1c') Jun 26 10:37:13.814749 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] calling os-brick to detach iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 26 10:37:13.815160 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb', 'iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:37:13.815344 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:37:13.815786 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:37:13.816218 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb', 'iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 10:37:13.816383 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb', 0)] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 10:37:13.845342 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:13.845342 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:13.845342 np0000003731 nova-compute[98967]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb (non-flash) Jun 26 10:37:13.845342 np0000003731 nova-compute[98967]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb (non-flash) Jun 26 10:37:13.845342 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:13.845740 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:13.845740 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:13.845740 np0000003731 nova-compute[98967]: tcp: [4] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb (non-flash) Jun 26 10:37:13.845740 np0000003731 nova-compute[98967]: tcp: [5] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb (non-flash) Jun 26 10:37:13.845740 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:13.845740 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb', '4'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb', '5')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 10:37:13.845964 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb', '5')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:37:13.849965 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb', '4')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:37:13.850945 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Resulting device map defaultdict(. at 0x75f07065e980>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb'): ({'sdd'}, set())}) {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 10:37:13.851313 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Removing multipathed devices sdd, sde {{(pid=98967) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 10:37:13.851617 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Flush multipath device 330000000ebd9ab8b {{(pid=98967) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 26 10:37:13.887465 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:37:13.906174 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance d48c4183-618a-4abc-9d4c-956576c74490 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:37:13.906283 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance 81a0f65d-2017-4275-aabe-88bc8c81225d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:37:13.906391 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance d26dc4db-d71c-43b9-811a-d39b111be119 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:37:13.906487 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance c43215aa-be15-4556-8162-bcd9793048c0 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:37:13.906571 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance 0b93909a-db10-4b65-b5a7-0aa3f0a47da7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:37:13.906787 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance 64a636b4-e106-4968-8740-9938e9b2bcc8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:37:13.906787 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance 5bc6474f-1a05-4e8a-9553-a5597c60728d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:37:13.906902 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance a686feac-bebe-47c8-a3c8-f3c2260ca7f5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:37:13.944033 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:37:14.003638 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 10:37:14.003838 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 10:37:14.005266 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 10:37:14.022748 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 10:37:14.023055 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb')] {{(pid=98967) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 10:37:14.028529 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-4d38bf49-0b99-4054-aea1-bf12705db6b0 req-ab2c2adc-5140-45ca-9507-c8083ad59d53 service nova] Releasing lock "refresh_cache-a686feac-bebe-47c8-a3c8-f3c2260ca7f5" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:14.040105 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:14.082043 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 5, target: iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb, portal: 192.168.40.100,3260] Jun 26 10:37:14.082043 np0000003731 nova-compute[98967]: Logout of [sid: 5, target: iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb, portal: 192.168.40.100,3260] successful. Jun 26 10:37:14.082043 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:14.098087 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Starting instance... {{(pid=98967) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 26 10:37:14.102497 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:14.115597 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:14.146119 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Successfully updated port: 99b479ce-38b6-464c-a476-7039543e31d9 {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:37:14.150150 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Found default for hw_cdrom_bus of ide {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:14.150530 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Found default for hw_disk_bus of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:14.151113 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Found default for hw_input_bus of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:14.151590 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Found default for hw_pointer_model of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:14.152666 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Found default for hw_video_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:14.154012 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Found default for hw_vif_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:14.159799 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 4, target: iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb, portal: 192.168.50.100,3260] Jun 26 10:37:14.159799 np0000003731 nova-compute[98967]: Logout of [sid: 4, target: iqn.2023-03.storpool.com:os--volume-b4f1ecc9-2af3-484b-b5ca-96b15dbf8adb, portal: 192.168.50.100,3260] successful. Jun 26 10:37:14.159799 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:14.165746 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:14.168471 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:14.168546 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] VM Resumed (Lifecycle Event) Jun 26 10:37:14.182699 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:14.184068 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.367s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:37:14.184068 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] <== disconnect_volume: return (368ms) None {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:37:14.184475 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Disconnected iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 26 10:37:14.185591 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Deleting instance files /opt/stack/data/nova/instances/d48c4183-618a-4abc-9d4c-956576c74490_del Jun 26 10:37:14.187627 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Deletion of /opt/stack/data/nova/instances/d48c4183-618a-4abc-9d4c-956576c74490_del complete Jun 26 10:37:14.368326 np0000003731 nova-compute[98967]: INFO nova.virt.block_device [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Booting with volume f6728418-9234-41c7-befe-b38ee3265ba4 at /dev/vdc Jun 26 10:37:14.409346 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3 has been scheduled to this compute host, the scheduler has made an allocation against this compute node but the instance has yet to start. Skipping heal of allocation: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1797}} Jun 26 10:37:14.409660 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Total usable vcpus: 16, total allocated vcpus: 8 {{(pid=98967) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 26 10:37:14.409861 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Final resource view: name=np0000003731 phys_ram=64301MB used_ram=2048MB phys_disk=95GB used_disk=6GB total_vcpus=16 used_vcpus=8 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 10:37:12 up 26 min, 2 users, load average: 9.44, 3.80, 1.78\n', 'num_instances': '8', 'num_vm_active': '5', 'num_task_deleting': '1', 'num_os_type_None': '8', 'num_proj_acf021cccf734aff828c39edc32e8b5e': '1', 'io_workload': '3', 'num_task_None': '4', 'num_proj_39600b204ad64a6db28676693c86dd70': '1', 'num_proj_49c2798faed447838b6c87f6d15cce66': '1', 'num_proj_f37c91742d834881a1ec62e1eb1ecdcf': '1', 'num_vm_building': '3', 'num_task_spawning': '2', 'num_proj_b4242a2b73cf4564ac8f9f2cb9c7a7bf': '2', 'num_proj_f006893b34fb45e7bf33415299ffc934': '1', 'num_task_block_device_mapping': '1', 'num_proj_93df6885279b4537969fc0d1beb9f198': '1'} {{(pid=98967) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 26 10:37:14.418581 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.79', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003731', 'execute': None}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:37:14.432368 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.scaleio [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98967) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 10:37:14.456531 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Running cmd (subprocess): nvme version {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:14.490258 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] 'nvme version' failed. Not Retrying. {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 10:37:14.491067 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.nvmeof [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] nvme not present on system {{(pid=98967) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 10:37:14.503352 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98967) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 10:37:14.505022 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.lightos [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Current host hostNQN and IP(s) are ['10.4.3.79', 'fe80::f816:3eff:fe55:ba34', '192.168.40.6', 'fe80::f816:3eff:fe6b:fe1a', '192.168.50.6', 'fe80::f816:3eff:feca:9cd0', '192.168.10.6', 'fe80::f816:3eff:feb4:4e78', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f8bb:38ff:fe28:ff4a', 'fe80::fc16:3eff:fe4c:ec5e', 'fe80::1cb1:31ff:fe57:6a2', 'fe80::fc16:3eff:fe56:c774', 'fe80::a4ca:b5ff:fe12:2c3c', 'fe80::fc16:3eff:fe37:b3f6', 'fe80::41a:feff:fe02:479d', 'fe80::fc16:3eff:fef2:11a', 'fe80::a061:7eff:feb6:8085', 'fe80::fc16:3eff:fe4b:6e75', 'fe80::fc16:3eff:fe3a:ece4', 'fe80::60f0:e4ff:fe6b:bf4c'] Jun 26 10:37:14.505237 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 10:37:14.505343 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] LIGHTOS: no hostnqn found. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 10:37:14.505659 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] <== get_connector_properties: return (86ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.79', 'host': 'np0000003731', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:2fddcc2116d6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '7f2a0776-2f14-4357-a22e-baa6677eb22e', 'nvme_native_multipath': False} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:37:14.505919 np0000003731 nova-compute[98967]: DEBUG nova.virt.block_device [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Updating existing volume attachment record: 3fdbb2a5-d3cd-4aa1-91fa-0f5c07bdd184 {{(pid=98967) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 26 10:37:14.669158 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Took 8.72 seconds to spawn the instance on the hypervisor. Jun 26 10:37:14.669158 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:14.670471 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:14.671940 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:14.676422 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:37:14.704643 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Took 1.80 seconds to destroy the instance on the hypervisor. Jun 26 10:37:14.707544 np0000003731 nova-compute[98967]: DEBUG oslo.service.backend._common.loopingcall [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98967) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 26 10:37:14.709324 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [-] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Deallocating network for instance {{(pid=98967) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 26 10:37:14.709324 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [-] [instance: d48c4183-618a-4abc-9d4c-956576c74490] deallocate_for_instance() {{(pid=98967) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 26 10:37:14.709324 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:14.815942 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:14.874175 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-3a561b8e-ec12-49ab-be3f-71693825a7d7 req-533944b2-cf0e-4ccc-9cf0-556ae3bbdec8 service nova] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Received event network-vif-plugged-6055bbc4-aeb1-4b68-a104-fd89f90067cf {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:14.874175 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-3a561b8e-ec12-49ab-be3f-71693825a7d7 req-533944b2-cf0e-4ccc-9cf0-556ae3bbdec8 service nova] Acquiring lock "5bc6474f-1a05-4e8a-9553-a5597c60728d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:14.874337 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-3a561b8e-ec12-49ab-be3f-71693825a7d7 req-533944b2-cf0e-4ccc-9cf0-556ae3bbdec8 service nova] Lock "5bc6474f-1a05-4e8a-9553-a5597c60728d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:14.874479 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-3a561b8e-ec12-49ab-be3f-71693825a7d7 req-533944b2-cf0e-4ccc-9cf0-556ae3bbdec8 service nova] Lock "5bc6474f-1a05-4e8a-9553-a5597c60728d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:14.874603 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-3a561b8e-ec12-49ab-be3f-71693825a7d7 req-533944b2-cf0e-4ccc-9cf0-556ae3bbdec8 service nova] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] No waiting events found dispatching network-vif-plugged-6055bbc4-aeb1-4b68-a104-fd89f90067cf {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:37:14.874775 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-3a561b8e-ec12-49ab-be3f-71693825a7d7 req-533944b2-cf0e-4ccc-9cf0-556ae3bbdec8 service nova] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Received unexpected event network-vif-plugged-6055bbc4-aeb1-4b68-a104-fd89f90067cf for instance with vm_state active and task_state None. Jun 26 10:37:14.874883 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-3a561b8e-ec12-49ab-be3f-71693825a7d7 req-533944b2-cf0e-4ccc-9cf0-556ae3bbdec8 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-changed-99b479ce-38b6-464c-a476-7039543e31d9 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:14.875063 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-3a561b8e-ec12-49ab-be3f-71693825a7d7 req-533944b2-cf0e-4ccc-9cf0-556ae3bbdec8 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Refreshing instance network info cache due to event network-changed-99b479ce-38b6-464c-a476-7039543e31d9. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:37:14.875241 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-3a561b8e-ec12-49ab-be3f-71693825a7d7 req-533944b2-cf0e-4ccc-9cf0-556ae3bbdec8 service nova] Acquiring lock "refresh_cache-a686feac-bebe-47c8-a3c8-f3c2260ca7f5" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:14.875363 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-3a561b8e-ec12-49ab-be3f-71693825a7d7 req-533944b2-cf0e-4ccc-9cf0-556ae3bbdec8 service nova] Acquired lock "refresh_cache-a686feac-bebe-47c8-a3c8-f3c2260ca7f5" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:14.875572 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-3a561b8e-ec12-49ab-be3f-71693825a7d7 req-533944b2-cf0e-4ccc-9cf0-556ae3bbdec8 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Refreshing network info cache for port 99b479ce-38b6-464c-a476-7039543e31d9 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:37:15.042625 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:37:15.042840 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:37:15.179459 np0000003731 nova-compute[98967]: DEBUG nova.utils [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Queued Task(fn=>, remaining_delay=14.999215374999949 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:37:15.181840 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.997777997999947 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:37:15.183528 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.99628398599998 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:37:15.183528 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:15.183528 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] VM Started (Lifecycle Event) Jun 26 10:37:15.185416 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:15.187839 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Took 19.11 seconds to build instance. Jun 26 10:37:15.379361 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-3a561b8e-ec12-49ab-be3f-71693825a7d7 req-533944b2-cf0e-4ccc-9cf0-556ae3bbdec8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:15.462430 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-6346d65c-0cb2-4360-8caa-129e4c2428b6 req-9ef6de7b-88c2-48ba-b036-5f7a19192c4e service nova] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Received event network-vif-plugged-f3b40b67-c684-437c-83df-5ff22d2249e8 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:15.462430 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-6346d65c-0cb2-4360-8caa-129e4c2428b6 req-9ef6de7b-88c2-48ba-b036-5f7a19192c4e service nova] Acquiring lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:15.462430 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-6346d65c-0cb2-4360-8caa-129e4c2428b6 req-9ef6de7b-88c2-48ba-b036-5f7a19192c4e service nova] Lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:15.462430 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-6346d65c-0cb2-4360-8caa-129e4c2428b6 req-9ef6de7b-88c2-48ba-b036-5f7a19192c4e service nova] Lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:15.462430 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-6346d65c-0cb2-4360-8caa-129e4c2428b6 req-9ef6de7b-88c2-48ba-b036-5f7a19192c4e service nova] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Processing event network-vif-plugged-f3b40b67-c684-437c-83df-5ff22d2249e8 {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:37:15.462430 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Instance event wait completed in 6 seconds for network-vif-plugged {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:37:15.463400 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Guest created on hypervisor {{(pid=98967) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 26 10:37:15.478106 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Instance spawned successfully. Jun 26 10:37:15.478427 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 26 10:37:15.545873 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:37:15.578847 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-3a561b8e-ec12-49ab-be3f-71693825a7d7 req-533944b2-cf0e-4ccc-9cf0-556ae3bbdec8 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:37:15.691411 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:15.691411 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Lock "5bc6474f-1a05-4e8a-9553-a5597c60728d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 20.624s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:15.706644 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:37:15.759613 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Successfully updated port: a8a13bff-3694-4c1e-a5ae-486d72b71662 {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:37:15.833320 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-5aa6853a-aaad-42b6-bc2c-c4e02973b353 req-0a9b3ef2-0243-457c-9af6-cb248def4e9c service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-changed-a8a13bff-3694-4c1e-a5ae-486d72b71662 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:15.834428 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-5aa6853a-aaad-42b6-bc2c-c4e02973b353 req-0a9b3ef2-0243-457c-9af6-cb248def4e9c service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Refreshing instance network info cache due to event network-changed-a8a13bff-3694-4c1e-a5ae-486d72b71662. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:37:15.834616 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5aa6853a-aaad-42b6-bc2c-c4e02973b353 req-0a9b3ef2-0243-457c-9af6-cb248def4e9c service nova] Acquiring lock "refresh_cache-a686feac-bebe-47c8-a3c8-f3c2260ca7f5" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:15.904124 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-3a561b8e-ec12-49ab-be3f-71693825a7d7 req-533944b2-cf0e-4ccc-9cf0-556ae3bbdec8 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:15.983630 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Found default for hw_cdrom_bus of ide {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:15.986026 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Found default for hw_disk_bus of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:15.986026 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Found default for hw_input_bus of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:15.986026 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Found default for hw_pointer_model of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:15.986026 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Found default for hw_video_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:15.986026 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Found default for hw_vif_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:16.024764 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [-] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:16.055035 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Compute_service record updated for np0000003731:np0000003731 {{(pid=98967) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 26 10:37:16.055195 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.234s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:16.055641 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.385s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:16.056725 np0000003731 nova-compute[98967]: DEBUG oslo.service.backend._threading.loopingcall [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 58.20 seconds {{(pid=98967) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 26 10:37:16.060334 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98967) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 26 10:37:16.060543 np0000003731 nova-compute[98967]: INFO nova.compute.claims [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Claim successful on node np0000003731 Jun 26 10:37:16.198119 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Paused> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:16.198119 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] VM Paused (Lifecycle Event) Jun 26 10:37:16.389621 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-3a561b8e-ec12-49ab-be3f-71693825a7d7 req-533944b2-cf0e-4ccc-9cf0-556ae3bbdec8 service nova] Releasing lock "refresh_cache-a686feac-bebe-47c8-a3c8-f3c2260ca7f5" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:16.389884 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5aa6853a-aaad-42b6-bc2c-c4e02973b353 req-0a9b3ef2-0243-457c-9af6-cb248def4e9c service nova] Acquired lock "refresh_cache-a686feac-bebe-47c8-a3c8-f3c2260ca7f5" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:16.390054 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-5aa6853a-aaad-42b6-bc2c-c4e02973b353 req-0a9b3ef2-0243-457c-9af6-cb248def4e9c service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Refreshing network info cache for port a8a13bff-3694-4c1e-a5ae-486d72b71662 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:37:16.491205 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Took 15.75 seconds to spawn the instance on the hypervisor. Jun 26 10:37:16.491352 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:16.526885 np0000003731 nova-compute[98967]: INFO nova.compute.manager [-] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Took 1.82 seconds to deallocate network for instance. Jun 26 10:37:16.700320 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:16.702360 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:16.702532 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] VM Resumed (Lifecycle Event) Jun 26 10:37:16.759667 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Start spawning the instance on the hypervisor. {{(pid=98967) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 26 10:37:16.760670 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Creating instance directory {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 26 10:37:16.760918 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Creating image(s) Jun 26 10:37:16.761232 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Did not create local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 26 10:37:16.761407 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Ensure instance console log exists: /opt/stack/data/nova/instances/a686feac-bebe-47c8-a3c8-f3c2260ca7f5/console.log {{(pid=98967) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 26 10:37:16.761650 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:16.761831 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:16.762056 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:16.896587 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-5aa6853a-aaad-42b6-bc2c-c4e02973b353 req-0a9b3ef2-0243-457c-9af6-cb248def4e9c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:16.916801 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Successfully updated port: f141a8bb-5a71-4872-b62f-9fce6052875a {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:37:16.950827 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-f91ec628-9fad-4381-905f-56312261d205 req-eb3ee475-6cab-4c6f-89be-f0f5048fec13 service nova] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Received event network-vif-deleted-354a4b12-1c99-40fe-9c24-5e9a8aa3293f {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:16.979060 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-5aa6853a-aaad-42b6-bc2c-c4e02973b353 req-0a9b3ef2-0243-457c-9af6-cb248def4e9c service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:37:17.003798 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Took 24.60 seconds to build instance. Jun 26 10:37:17.219333 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:17.219333 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-5aa6853a-aaad-42b6-bc2c-c4e02973b353 req-0a9b3ef2-0243-457c-9af6-cb248def4e9c service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:17.221513 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:37:17.243049 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Took 0.72 seconds to detach 1 volumes for instance. Jun 26 10:37:17.365316 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:17.511746 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 26.113s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:17.541035 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-706102a4-5469-4f5e-af19-385e2844efa1 req-9d43772f-7ead-4799-987d-4b8e22979c98 service nova] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Received event network-vif-plugged-f3b40b67-c684-437c-83df-5ff22d2249e8 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:17.542532 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-706102a4-5469-4f5e-af19-385e2844efa1 req-9d43772f-7ead-4799-987d-4b8e22979c98 service nova] Acquiring lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:17.542716 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-706102a4-5469-4f5e-af19-385e2844efa1 req-9d43772f-7ead-4799-987d-4b8e22979c98 service nova] Lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:17.542945 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-706102a4-5469-4f5e-af19-385e2844efa1 req-9d43772f-7ead-4799-987d-4b8e22979c98 service nova] Lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:17.542945 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-706102a4-5469-4f5e-af19-385e2844efa1 req-9d43772f-7ead-4799-987d-4b8e22979c98 service nova] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] No waiting events found dispatching network-vif-plugged-f3b40b67-c684-437c-83df-5ff22d2249e8 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:37:17.543039 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-706102a4-5469-4f5e-af19-385e2844efa1 req-9d43772f-7ead-4799-987d-4b8e22979c98 service nova] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Received unexpected event network-vif-plugged-f3b40b67-c684-437c-83df-5ff22d2249e8 for instance with vm_state active and task_state None. Jun 26 10:37:17.543140 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-706102a4-5469-4f5e-af19-385e2844efa1 req-9d43772f-7ead-4799-987d-4b8e22979c98 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-unplugged-38973918-1218-4531-8941-0e9fbff30e3e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:17.543256 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-706102a4-5469-4f5e-af19-385e2844efa1 req-9d43772f-7ead-4799-987d-4b8e22979c98 service nova] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:17.543349 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-706102a4-5469-4f5e-af19-385e2844efa1 req-9d43772f-7ead-4799-987d-4b8e22979c98 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:17.543476 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-706102a4-5469-4f5e-af19-385e2844efa1 req-9d43772f-7ead-4799-987d-4b8e22979c98 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:17.543719 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-706102a4-5469-4f5e-af19-385e2844efa1 req-9d43772f-7ead-4799-987d-4b8e22979c98 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] No waiting events found dispatching network-vif-unplugged-38973918-1218-4531-8941-0e9fbff30e3e {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:37:17.543719 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-706102a4-5469-4f5e-af19-385e2844efa1 req-9d43772f-7ead-4799-987d-4b8e22979c98 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received unexpected event network-vif-unplugged-38973918-1218-4531-8941-0e9fbff30e3e for instance with vm_state building and task_state spawning. Jun 26 10:37:17.713264 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5aa6853a-aaad-42b6-bc2c-c4e02973b353 req-0a9b3ef2-0243-457c-9af6-cb248def4e9c service nova] Releasing lock "refresh_cache-a686feac-bebe-47c8-a3c8-f3c2260ca7f5" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:17.724498 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:17.724801 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] VM Resumed (Lifecycle Event) Jun 26 10:37:17.750566 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:17.752464 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:37:17.752679 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:37:17.921575 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-845d2c4e-0472-4c4d-97fc-5ceb2c3eddf1 req-e38799da-6bbe-45c7-b626-75d8fa512164 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-changed-f141a8bb-5a71-4872-b62f-9fce6052875a {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:17.921725 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-845d2c4e-0472-4c4d-97fc-5ceb2c3eddf1 req-e38799da-6bbe-45c7-b626-75d8fa512164 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Refreshing instance network info cache due to event network-changed-f141a8bb-5a71-4872-b62f-9fce6052875a. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:37:17.921885 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-845d2c4e-0472-4c4d-97fc-5ceb2c3eddf1 req-e38799da-6bbe-45c7-b626-75d8fa512164 service nova] Acquiring lock "refresh_cache-a686feac-bebe-47c8-a3c8-f3c2260ca7f5" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:17.922029 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-845d2c4e-0472-4c4d-97fc-5ceb2c3eddf1 req-e38799da-6bbe-45c7-b626-75d8fa512164 service nova] Acquired lock "refresh_cache-a686feac-bebe-47c8-a3c8-f3c2260ca7f5" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:17.922116 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-845d2c4e-0472-4c4d-97fc-5ceb2c3eddf1 req-e38799da-6bbe-45c7-b626-75d8fa512164 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Refreshing network info cache for port f141a8bb-5a71-4872-b62f-9fce6052875a {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:37:18.157155 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Successfully updated port: fa54a649-79c1-4413-91b2-680216f8b045 {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:37:18.227593 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:18.231499 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:37:18.255650 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:37:18.423975 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-845d2c4e-0472-4c4d-97fc-5ceb2c3eddf1 req-e38799da-6bbe-45c7-b626-75d8fa512164 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:18.549372 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-845d2c4e-0472-4c4d-97fc-5ceb2c3eddf1 req-e38799da-6bbe-45c7-b626-75d8fa512164 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:37:18.763736 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.708s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:18.764248 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Start building networks asynchronously for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 26 10:37:18.769859 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.014s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:18.816293 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:18.831232 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-845d2c4e-0472-4c4d-97fc-5ceb2c3eddf1 req-e38799da-6bbe-45c7-b626-75d8fa512164 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:19.033986 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-710b9688-878c-4fac-bfc7-50de837af58c req-08a9a639-57bb-477c-a3e2-23e41030bc3c service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-changed-fa54a649-79c1-4413-91b2-680216f8b045 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:19.034761 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-710b9688-878c-4fac-bfc7-50de837af58c req-08a9a639-57bb-477c-a3e2-23e41030bc3c service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Refreshing instance network info cache due to event network-changed-fa54a649-79c1-4413-91b2-680216f8b045. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:37:19.034761 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-710b9688-878c-4fac-bfc7-50de837af58c req-08a9a639-57bb-477c-a3e2-23e41030bc3c service nova] Acquiring lock "refresh_cache-a686feac-bebe-47c8-a3c8-f3c2260ca7f5" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:19.274206 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Allocating IP information in the background. {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 26 10:37:19.275492 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] allocate_for_instance() {{(pid=98967) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 26 10:37:19.275864 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:19.276219 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:19.337993 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-845d2c4e-0472-4c4d-97fc-5ceb2c3eddf1 req-e38799da-6bbe-45c7-b626-75d8fa512164 service nova] Releasing lock "refresh_cache-a686feac-bebe-47c8-a3c8-f3c2260ca7f5" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:19.340416 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-710b9688-878c-4fac-bfc7-50de837af58c req-08a9a639-57bb-477c-a3e2-23e41030bc3c service nova] Acquired lock "refresh_cache-a686feac-bebe-47c8-a3c8-f3c2260ca7f5" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:19.340660 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-710b9688-878c-4fac-bfc7-50de837af58c req-08a9a639-57bb-477c-a3e2-23e41030bc3c service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Refreshing network info cache for port fa54a649-79c1-4413-91b2-680216f8b045 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:37:19.385079 np0000003731 nova-compute[98967]: DEBUG nova.policy [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8a8a0b0240a34fb0bcf62ee7ec259cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2798faed447838b6c87f6d15cce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98967) authorize /opt/stack/nova/nova/policy.py:192}} Jun 26 10:37:19.426183 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:37:19.426794 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:37:19.433175 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-77831781-0995-41e2-b87e-810e748f6916 req-a318ac15-c847-48bd-95e1-4243802861ac service nova] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Received event network-changed-2608654f-5761-4d82-a2ab-2a67e20a1c08 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:19.433175 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-77831781-0995-41e2-b87e-810e748f6916 req-a318ac15-c847-48bd-95e1-4243802861ac service nova] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Refreshing instance network info cache due to event network-changed-2608654f-5761-4d82-a2ab-2a67e20a1c08. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:37:19.433175 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-77831781-0995-41e2-b87e-810e748f6916 req-a318ac15-c847-48bd-95e1-4243802861ac service nova] Acquiring lock "refresh_cache-64a636b4-e106-4968-8740-9938e9b2bcc8" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:19.433175 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-77831781-0995-41e2-b87e-810e748f6916 req-a318ac15-c847-48bd-95e1-4243802861ac service nova] Acquired lock "refresh_cache-64a636b4-e106-4968-8740-9938e9b2bcc8" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:19.433175 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-77831781-0995-41e2-b87e-810e748f6916 req-a318ac15-c847-48bd-95e1-4243802861ac service nova] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Refreshing network info cache for port 2608654f-5761-4d82-a2ab-2a67e20a1c08 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:37:19.499805 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Successfully updated port: 4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:37:19.617691 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7e1feb4f-8eec-4501-b378-8108453d1c79 req-ede4b993-e263-419f-aafc-9ac067b96bf8 service nova] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Received event network-changed-6055bbc4-aeb1-4b68-a104-fd89f90067cf {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:19.617841 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7e1feb4f-8eec-4501-b378-8108453d1c79 req-ede4b993-e263-419f-aafc-9ac067b96bf8 service nova] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Refreshing instance network info cache due to event network-changed-6055bbc4-aeb1-4b68-a104-fd89f90067cf. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:37:19.617985 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7e1feb4f-8eec-4501-b378-8108453d1c79 req-ede4b993-e263-419f-aafc-9ac067b96bf8 service nova] Acquiring lock "refresh_cache-5bc6474f-1a05-4e8a-9553-a5597c60728d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:19.618092 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7e1feb4f-8eec-4501-b378-8108453d1c79 req-ede4b993-e263-419f-aafc-9ac067b96bf8 service nova] Acquired lock "refresh_cache-5bc6474f-1a05-4e8a-9553-a5597c60728d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:19.618191 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-7e1feb4f-8eec-4501-b378-8108453d1c79 req-ede4b993-e263-419f-aafc-9ac067b96bf8 service nova] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Refreshing network info cache for port 6055bbc4-aeb1-4b68-a104-fd89f90067cf {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:37:19.775947 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 26 10:37:19.844841 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-710b9688-878c-4fac-bfc7-50de837af58c req-08a9a639-57bb-477c-a3e2-23e41030bc3c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:19.931222 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:37:19.937223 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-77831781-0995-41e2-b87e-810e748f6916 req-a318ac15-c847-48bd-95e1-4243802861ac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:19.946231 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-710b9688-878c-4fac-bfc7-50de837af58c req-08a9a639-57bb-477c-a3e2-23e41030bc3c service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:37:19.993063 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Successfully created port: 09c4d8fd-840e-4d7a-98c9-f3422893bbba {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:37:20.125624 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-7e1feb4f-8eec-4501-b378-8108453d1c79 req-ede4b993-e263-419f-aafc-9ac067b96bf8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:20.184262 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-710b9688-878c-4fac-bfc7-50de837af58c req-08a9a639-57bb-477c-a3e2-23e41030bc3c service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:20.284155 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Start building block device mappings for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 26 10:37:20.425704 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-77831781-0995-41e2-b87e-810e748f6916 req-a318ac15-c847-48bd-95e1-4243802861ac service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:20.449400 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.685s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:20.546837 np0000003731 nova-compute[98967]: INFO nova.scheduler.client.report [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Deleted allocations for instance d48c4183-618a-4abc-9d4c-956576c74490 Jun 26 10:37:20.560967 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-7e1feb4f-8eec-4501-b378-8108453d1c79 req-ede4b993-e263-419f-aafc-9ac067b96bf8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:20.609497 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Successfully updated port: 53ab7bb3-88bd-4061-9d43-b6392e20c003 {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:37:20.634303 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Successfully updated port: 09c4d8fd-840e-4d7a-98c9-f3422893bbba {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:37:20.647933 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-77831781-0995-41e2-b87e-810e748f6916 req-a318ac15-c847-48bd-95e1-4243802861ac service nova] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Updated VIF entry in instance network info cache for port 2608654f-5761-4d82-a2ab-2a67e20a1c08. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:37:20.648771 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-77831781-0995-41e2-b87e-810e748f6916 req-a318ac15-c847-48bd-95e1-4243802861ac service nova] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Updating instance_info_cache with network_info: [{"id": "2608654f-5761-4d82-a2ab-2a67e20a1c08", "address": "fa:16:3e:4b:6e:75", "network": {"id": "ee9d6726-90f0-4fdf-978b-d97dc4dc243d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1209858046-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b4242a2b73cf4564ac8f9f2cb9c7a7bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2608654f-57", "ovs_interfaceid": "2608654f-5761-4d82-a2ab-2a67e20a1c08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:20.686445 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-710b9688-878c-4fac-bfc7-50de837af58c req-08a9a639-57bb-477c-a3e2-23e41030bc3c service nova] Releasing lock "refresh_cache-a686feac-bebe-47c8-a3c8-f3c2260ca7f5" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:20.755720 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-7e1feb4f-8eec-4501-b378-8108453d1c79 req-ede4b993-e263-419f-aafc-9ac067b96bf8 service nova] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Updated VIF entry in instance network info cache for port 6055bbc4-aeb1-4b68-a104-fd89f90067cf. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:37:20.755971 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-7e1feb4f-8eec-4501-b378-8108453d1c79 req-ede4b993-e263-419f-aafc-9ac067b96bf8 service nova] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Updating instance_info_cache with network_info: [{"id": "6055bbc4-aeb1-4b68-a104-fd89f90067cf", "address": "fa:16:3e:3a:ec:e4", "network": {"id": "6a21b76b-0047-4efe-ae27-7a07d157c13a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1520786875-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f006893b34fb45e7bf33415299ffc934", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6055bbc4-ae", "ovs_interfaceid": "6055bbc4-aeb1-4b68-a104-fd89f90067cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:21.113900 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Acquiring lock "refresh_cache-a686feac-bebe-47c8-a3c8-f3c2260ca7f5" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:21.114925 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Acquired lock "refresh_cache-a686feac-bebe-47c8-a3c8-f3c2260ca7f5" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:21.114925 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:37:21.136632 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "refresh_cache-4b4a4a7e-d584-427e-91d2-7d9e710ea2a3" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:21.136797 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquired lock "refresh_cache-4b4a4a7e-d584-427e-91d2-7d9e710ea2a3" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:21.137017 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:37:21.151112 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-77831781-0995-41e2-b87e-810e748f6916 req-a318ac15-c847-48bd-95e1-4243802861ac service nova] Releasing lock "refresh_cache-64a636b4-e106-4968-8740-9938e9b2bcc8" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:21.259458 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7e1feb4f-8eec-4501-b378-8108453d1c79 req-ede4b993-e263-419f-aafc-9ac067b96bf8 service nova] Releasing lock "refresh_cache-5bc6474f-1a05-4e8a-9553-a5597c60728d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:21.259657 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7e1feb4f-8eec-4501-b378-8108453d1c79 req-ede4b993-e263-419f-aafc-9ac067b96bf8 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-changed-4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:21.259784 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7e1feb4f-8eec-4501-b378-8108453d1c79 req-ede4b993-e263-419f-aafc-9ac067b96bf8 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Refreshing instance network info cache due to event network-changed-4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:37:21.259904 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7e1feb4f-8eec-4501-b378-8108453d1c79 req-ede4b993-e263-419f-aafc-9ac067b96bf8 service nova] Acquiring lock "refresh_cache-a686feac-bebe-47c8-a3c8-f3c2260ca7f5" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:21.293929 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Start spawning the instance on the hypervisor. {{(pid=98967) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 26 10:37:21.294970 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Creating instance directory {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 26 10:37:21.295298 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Creating image(s) Jun 26 10:37:21.295824 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "/opt/stack/data/nova/instances/4b4a4a7e-d584-427e-91d2-7d9e710ea2a3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:21.296499 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "/opt/stack/data/nova/instances/4b4a4a7e-d584-427e-91d2-7d9e710ea2a3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:21.296597 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "/opt/stack/data/nova/instances/4b4a4a7e-d584-427e-91d2-7d9e710ea2a3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:21.297179 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:21.301177 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:21.302496 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:21.390337 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.087s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:21.391086 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:21.391746 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:21.392154 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:21.399545 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:21.399842 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:21.435655 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:21.472782 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.073s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:21.473277 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/4b4a4a7e-d584-427e-91d2-7d9e710ea2a3/disk 1073741824 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:21.515838 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/4b4a4a7e-d584-427e-91d2-7d9e710ea2a3/disk 1073741824" returned: 0 in 0.042s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:21.518219 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.127s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:21.518781 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:21.530568 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-a7d17a54-101e-4bef-af36-bcd893c3a2a8 req-79f9abcb-9be9-48c0-b6c4-2d0628b09989 service nova] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Received event network-changed-09c4d8fd-840e-4d7a-98c9-f3422893bbba {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:21.530823 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-a7d17a54-101e-4bef-af36-bcd893c3a2a8 req-79f9abcb-9be9-48c0-b6c4-2d0628b09989 service nova] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Refreshing instance network info cache due to event network-changed-09c4d8fd-840e-4d7a-98c9-f3422893bbba. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:37:21.531105 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-a7d17a54-101e-4bef-af36-bcd893c3a2a8 req-79f9abcb-9be9-48c0-b6c4-2d0628b09989 service nova] Acquiring lock "refresh_cache-4b4a4a7e-d584-427e-91d2-7d9e710ea2a3" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:21.559379 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-3c10c35e-94cc-4fe8-bbb0-69259a13ff54 tempest-DeleteServersTestJSON-897256898 tempest-DeleteServersTestJSON-897256898-project-member] Lock "d48c4183-618a-4abc-9d4c-956576c74490" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 9.189s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:21.593643 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.074s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:21.594049 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Checking if we can resize image /opt/stack/data/nova/instances/4b4a4a7e-d584-427e-91d2-7d9e710ea2a3/disk. size=1073741824 {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 26 10:37:21.594563 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4a4a7e-d584-427e-91d2-7d9e710ea2a3/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:21.688450 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4a4a7e-d584-427e-91d2-7d9e710ea2a3/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:21.692501 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Cannot resize image /opt/stack/data/nova/instances/4b4a4a7e-d584-427e-91d2-7d9e710ea2a3/disk to a smaller size. {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 26 10:37:21.693423 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Created local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 26 10:37:21.693423 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Ensure instance console log exists: /opt/stack/data/nova/instances/4b4a4a7e-d584-427e-91d2-7d9e710ea2a3/console.log {{(pid=98967) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 26 10:37:21.693843 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:21.694178 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:21.694234 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:21.703898 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-74233eda-76d3-4bec-8431-c59fba84be68 req-06b0fd85-a17d-4262-86a7-5ad5f3a5f51c service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-changed-53ab7bb3-88bd-4061-9d43-b6392e20c003 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:21.704502 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-74233eda-76d3-4bec-8431-c59fba84be68 req-06b0fd85-a17d-4262-86a7-5ad5f3a5f51c service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Refreshing instance network info cache due to event network-changed-53ab7bb3-88bd-4061-9d43-b6392e20c003. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:37:21.704791 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-74233eda-76d3-4bec-8431-c59fba84be68 req-06b0fd85-a17d-4262-86a7-5ad5f3a5f51c service nova] Acquiring lock "refresh_cache-a686feac-bebe-47c8-a3c8-f3c2260ca7f5" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:21.734153 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:37:21.747531 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:37:21.857562 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:21.983026 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:22.014026 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:22.272052 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Updating instance_info_cache with network_info: [{"id": "09c4d8fd-840e-4d7a-98c9-f3422893bbba", "address": "fa:16:3e:5e:04:59", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c4d8fd-84", "ovs_interfaceid": "09c4d8fd-840e-4d7a-98c9-f3422893bbba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:22.367632 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:22.437197 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:22.776076 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Releasing lock "refresh_cache-4b4a4a7e-d584-427e-91d2-7d9e710ea2a3" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:22.776076 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Instance network_info: |[{"id": "09c4d8fd-840e-4d7a-98c9-f3422893bbba", "address": "fa:16:3e:5e:04:59", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c4d8fd-84", "ovs_interfaceid": "09c4d8fd-840e-4d7a-98c9-f3422893bbba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 26 10:37:22.777696 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Start _get_guest_xml network_info=[{"id": "09c4d8fd-840e-4d7a-98c9-f3422893bbba", "address": "fa:16:3e:5e:04:59", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c4d8fd-84", "ovs_interfaceid": "09c4d8fd-840e-4d7a-98c9-f3422893bbba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'image_id': 'a9b18127-6fee-4ed6-b364-a2d634ecb8b7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:37:22.778167 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-a7d17a54-101e-4bef-af36-bcd893c3a2a8 req-79f9abcb-9be9-48c0-b6c4-2d0628b09989 service nova] Acquired lock "refresh_cache-4b4a4a7e-d584-427e-91d2-7d9e710ea2a3" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:22.778532 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-a7d17a54-101e-4bef-af36-bcd893c3a2a8 req-79f9abcb-9be9-48c0-b6c4-2d0628b09989 service nova] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Refreshing network info cache for port 09c4d8fd-840e-4d7a-98c9-f3422893bbba {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:37:22.782107 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:37:22.782388 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='4b4a4a7e-d584-427e-91d2-7d9e710ea2a3'), owner=OwnerMeta(userid='8a8a0b0240a34fb0bcf62ee7ec259cb2', username='tempest-AttachVolumeMultiAttachTest-1668992443-project-member', projectid='49c2798faed447838b6c87f6d15cce66', projectname='tempest-AttachVolumeMultiAttachTest-1668992443'), image=ImageMeta(id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "09c4d8fd-840e-4d7a-98c9-f3422893bbba", "address": "fa:16:3e:5e:04:59", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c4d8fd-84", "ovs_interfaceid": "09c4d8fd-840e-4d7a-98c9-f3422893bbba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470242.7819657) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:37:22.783970 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:37:22.784234 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:37:22.785757 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:37:22.785757 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:37:22.786787 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:37:22.787197 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:37:22.787384 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:37:22.787482 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:37:22.787616 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:37:22.787698 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:37:22.787819 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:37:22.788100 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:37:22.788216 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:37:22.788644 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:37:22.788753 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:37:22.789301 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:37:22.805558 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='multiattach-server-0',id=9,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIANZiDTtI5cmApVvRJAaLuw+rm1nR4eCOZjHwVoNWhAR53DFExlyLfMWz+jjXnkCXdfpUcLxD2eMk9e+d1HV7SCzQccChfvPKV4jw2Mlc92UdPlKs2IxpAJWXP9L/ysw==',key_name='tempest-keypair-1990365436',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49c2798faed447838b6c87f6d15cce66',ramdisk_id='',reservation_id='r-lo0m6x29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1668992443',owner_user_name='tempest-AttachVolumeMultiAttachTest-1668992443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a8a0b0240a34fb0bcf62ee7ec259cb2',uuid=4b4a4a7e-d584-427e-91d2-7d9e710ea2a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09c4d8fd-840e-4d7a-98c9-f3422893bbba", "address": "fa:16:3e:5e:04:59", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c4d8fd-84", "ovs_interfaceid": "09c4d8fd-840e-4d7a-98c9-f3422893bbba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:37:22.805792 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Converting VIF {"id": "09c4d8fd-840e-4d7a-98c9-f3422893bbba", "address": "fa:16:3e:5e:04:59", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c4d8fd-84", "ovs_interfaceid": "09c4d8fd-840e-4d7a-98c9-f3422893bbba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:22.806536 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:04:59,bridge_name='br-int',has_traffic_filtering=True,id=09c4d8fd-840e-4d7a-98c9-f3422893bbba,network=Network(204eb6a3-9452-412e-ab0b-1594eb86bed2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c4d8fd-84') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:22.807373 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lazy-loading 'pci_devices' on Instance uuid 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:37:22.898828 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:23.281783 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-a7d17a54-101e-4bef-af36-bcd893c3a2a8 req-79f9abcb-9be9-48c0-b6c4-2d0628b09989 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] End _get_guest_xml xml= Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3 Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: instance-00000009 Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: 196608 Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: multiattach-server-0 Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: 2026-06-26 10:37:22 Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: 192 Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: True Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: bare Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: virtio Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: tempest-AttachVolumeMultiAttachTest-1668992443-project-member Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: tempest-AttachVolumeMultiAttachTest-1668992443 Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3 Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3 Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: hvm Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: 128 Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: Jun 26 10:37:23.311280 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:37:23.314891 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Preparing to wait for external event network-vif-plugged-09c4d8fd-840e-4d7a-98c9-f3422893bbba {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:37:23.314891 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "4b4a4a7e-d584-427e-91d2-7d9e710ea2a3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:23.314891 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "4b4a4a7e-d584-427e-91d2-7d9e710ea2a3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:23.314891 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "4b4a4a7e-d584-427e-91d2-7d9e710ea2a3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:23.314891 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:37:12Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='multiattach-server-0',id=9,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIANZiDTtI5cmApVvRJAaLuw+rm1nR4eCOZjHwVoNWhAR53DFExlyLfMWz+jjXnkCXdfpUcLxD2eMk9e+d1HV7SCzQccChfvPKV4jw2Mlc92UdPlKs2IxpAJWXP9L/ysw==',key_name='tempest-keypair-1990365436',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49c2798faed447838b6c87f6d15cce66',ramdisk_id='',reservation_id='r-lo0m6x29',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1668992443',owner_user_name='tempest-AttachVolumeMultiAttachTest-1668992443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:20Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a8a0b0240a34fb0bcf62ee7ec259cb2',uuid=4b4a4a7e-d584-427e-91d2-7d9e710ea2a3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "09c4d8fd-840e-4d7a-98c9-f3422893bbba", "address": "fa:16:3e:5e:04:59", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c4d8fd-84", "ovs_interfaceid": "09c4d8fd-840e-4d7a-98c9-f3422893bbba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:37:23.315489 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Converting VIF {"id": "09c4d8fd-840e-4d7a-98c9-f3422893bbba", "address": "fa:16:3e:5e:04:59", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c4d8fd-84", "ovs_interfaceid": "09c4d8fd-840e-4d7a-98c9-f3422893bbba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:23.316349 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5e:04:59,bridge_name='br-int',has_traffic_filtering=True,id=09c4d8fd-840e-4d7a-98c9-f3422893bbba,network=Network(204eb6a3-9452-412e-ab0b-1594eb86bed2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c4d8fd-84') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:23.316770 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:04:59,bridge_name='br-int',has_traffic_filtering=True,id=09c4d8fd-840e-4d7a-98c9-f3422893bbba,network=Network(204eb6a3-9452-412e-ab0b-1594eb86bed2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c4d8fd-84') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:37:23.317092 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:23.317418 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:23.318256 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:37:23.318530 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:23.318714 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '24aa7cd4-5dc8-58e8-9a0f-24f08efbadf9', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:23.321956 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:23.321956 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:23.321956 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:23.327500 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:23.327776 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap09c4d8fd-84, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:23.328215 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap09c4d8fd-84, col_values=(('qos', UUID('bcf42d5c-8300-442d-9bd5-ac528eba1ed5')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:23.328494 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap09c4d8fd-84, col_values=(('external_ids', {'iface-id': '09c4d8fd-840e-4d7a-98c9-f3422893bbba', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5e:04:59', 'vm-uuid': '4b4a4a7e-d584-427e-91d2-7d9e710ea2a3'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:23.330067 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:23.331205 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:23.338247 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:23.338784 np0000003731 nova-compute[98967]: INFO os_vif [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5e:04:59,bridge_name='br-int',has_traffic_filtering=True,id=09c4d8fd-840e-4d7a-98c9-f3422893bbba,network=Network(204eb6a3-9452-412e-ab0b-1594eb86bed2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap09c4d8fd-84') Jun 26 10:37:23.427984 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:23.582699 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:23.693782 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-a7d17a54-101e-4bef-af36-bcd893c3a2a8 req-79f9abcb-9be9-48c0-b6c4-2d0628b09989 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:23.840647 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:23.869192 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-a7d17a54-101e-4bef-af36-bcd893c3a2a8 req-79f9abcb-9be9-48c0-b6c4-2d0628b09989 service nova] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Updated VIF entry in instance network info cache for port 09c4d8fd-840e-4d7a-98c9-f3422893bbba. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:37:23.869510 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-a7d17a54-101e-4bef-af36-bcd893c3a2a8 req-79f9abcb-9be9-48c0-b6c4-2d0628b09989 service nova] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Updating instance_info_cache with network_info: [{"id": "09c4d8fd-840e-4d7a-98c9-f3422893bbba", "address": "fa:16:3e:5e:04:59", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c4d8fd-84", "ovs_interfaceid": "09c4d8fd-840e-4d7a-98c9-f3422893bbba", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:24.275977 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:24.372421 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-a7d17a54-101e-4bef-af36-bcd893c3a2a8 req-79f9abcb-9be9-48c0-b6c4-2d0628b09989 service nova] Releasing lock "refresh_cache-4b4a4a7e-d584-427e-91d2-7d9e710ea2a3" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:24.593437 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:24.776826 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Updating instance_info_cache with network_info: [{"id": "38973918-1218-4531-8941-0e9fbff30e3e", "address": "fa:16:3e:98:a5:6d", "network": {"id": "cc7daed3-e035-41b4-99f9-fb4b79e0045d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1956118171-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38973918-12", "ovs_interfaceid": "38973918-1218-4531-8941-0e9fbff30e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "99b479ce-38b6-464c-a476-7039543e31d9", "address": "fa:16:3e:9b:2a:95", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b479ce-38", "ovs_interfaceid": "99b479ce-38b6-464c-a476-7039543e31d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a8a13bff-3694-4c1e-a5ae-486d72b71662", "address": "fa:16:3e:0d:e8:58", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a13bff-36", "ovs_interfaceid": "a8a13bff-3694-4c1e-a5ae-486d72b71662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f141a8bb-5a71-4872-b62f-9fce6052875a", "address": "fa:16:3e:89:3b:98", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf141a8bb-5a", "ovs_interfaceid": "f141a8bb-5a71-4872-b62f-9fce6052875a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa54a649-79c1-4413-91b2-680216f8b045", "address": "fa:16:3e:4e:45:ca", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa54a649-79", "ovs_interfaceid": "fa54a649-79c1-4413-91b2-680216f8b045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a", "address": "fa:16:3e:fc:62:66", "network": {"id": "35589be9-ff77-40f5-8d6f-20e36bb2cd03", "bridge": "br-int", "label": "tempest-device-tagging-net2-1172567199", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0f4a94-bf", "ovs_interfaceid": "4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "53ab7bb3-88bd-4061-9d43-b6392e20c003", "address": "fa:16:3e:50:56:3a", "network": {"id": "35589be9-ff77-40f5-8d6f-20e36bb2cd03", "bridge": "br-int", "label": "tempest-device-tagging-net2-1172567199", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ab7bb3-88", "ovs_interfaceid": "53ab7bb3-88bd-4061-9d43-b6392e20c003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:24.860137 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:24.860137 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:24.860137 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No VIF found with MAC fa:16:3e:5e:04:59, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:37:24.860137 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Using config drive Jun 26 10:37:25.279197 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Releasing lock "refresh_cache-a686feac-bebe-47c8-a3c8-f3c2260ca7f5" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:25.279658 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Instance network_info: |[{"id": "38973918-1218-4531-8941-0e9fbff30e3e", "address": "fa:16:3e:98:a5:6d", "network": {"id": "cc7daed3-e035-41b4-99f9-fb4b79e0045d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1956118171-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38973918-12", "ovs_interfaceid": "38973918-1218-4531-8941-0e9fbff30e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "99b479ce-38b6-464c-a476-7039543e31d9", "address": "fa:16:3e:9b:2a:95", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b479ce-38", "ovs_interfaceid": "99b479ce-38b6-464c-a476-7039543e31d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a8a13bff-3694-4c1e-a5ae-486d72b71662", "address": "fa:16:3e:0d:e8:58", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a13bff-36", "ovs_interfaceid": "a8a13bff-3694-4c1e-a5ae-486d72b71662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f141a8bb-5a71-4872-b62f-9fce6052875a", "address": "fa:16:3e:89:3b:98", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf141a8bb-5a", "ovs_interfaceid": "f141a8bb-5a71-4872-b62f-9fce6052875a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa54a649-79c1-4413-91b2-680216f8b045", "address": "fa:16:3e:4e:45:ca", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa54a649-79", "ovs_interfaceid": "fa54a649-79c1-4413-91b2-680216f8b045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a", "address": "fa:16:3e:fc:62:66", "network": {"id": "35589be9-ff77-40f5-8d6f-20e36bb2cd03", "bridge": "br-int", "label": "tempest-device-tagging-net2-1172567199", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0f4a94-bf", "ovs_interfaceid": "4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "53ab7bb3-88bd-4061-9d43-b6392e20c003", "address": "fa:16:3e:50:56:3a", "network": {"id": "35589be9-ff77-40f5-8d6f-20e36bb2cd03", "bridge": "br-int", "label": "tempest-device-tagging-net2-1172567199", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ab7bb3-88", "ovs_interfaceid": "53ab7bb3-88bd-4061-9d43-b6392e20c003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 26 10:37:25.281647 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Start _get_guest_xml network_info=[{"id": "38973918-1218-4531-8941-0e9fbff30e3e", "address": "fa:16:3e:98:a5:6d", "network": {"id": "cc7daed3-e035-41b4-99f9-fb4b79e0045d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1956118171-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38973918-12", "ovs_interfaceid": "38973918-1218-4531-8941-0e9fbff30e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "99b479ce-38b6-464c-a476-7039543e31d9", "address": "fa:16:3e:9b:2a:95", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b479ce-38", "ovs_interfaceid": "99b479ce-38b6-464c-a476-7039543e31d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a8a13bff-3694-4c1e-a5ae-486d72b71662", "address": "fa:16:3e:0d:e8:58", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a13bff-36", "ovs_interfaceid": "a8a13bff-3694-4c1e-a5ae-486d72b71662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f141a8bb-5a71-4872-b62f-9fce6052875a", "address": "fa:16:3e:89:3b:98", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf141a8bb-5a", "ovs_interfaceid": "f141a8bb-5a71-4872-b62f-9fce6052875a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa54a649-79c1-4413-91b2-680216f8b045", "address": "fa:16:3e:4e:45:ca", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa54a649-79", "ovs_interfaceid": "fa54a649-79c1-4413-91b2-680216f8b045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a", "address": "fa:16:3e:fc:62:66", "network": {"id": "35589be9-ff77-40f5-8d6f-20e36bb2cd03", "bridge": "br-int", "label": "tempest-device-tagging-net2-1172567199", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0f4a94-bf", "ovs_interfaceid": "4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "53ab7bb3-88bd-4061-9d43-b6392e20c003", "address": "fa:16:3e:50:56:3a", "network": {"id": "35589be9-ff77-40f5-8d6f-20e36bb2cd03", "bridge": "br-int", "label": "tempest-device-tagging-net2-1172567199", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ab7bb3-88", "ovs_interfaceid": "53ab7bb3-88bd-4061-9d43-b6392e20c003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020', 'iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3cb9f515-cb6e-4822-8208-4bd6694ad020', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a686feac-bebe-47c8-a3c8-f3c2260ca7f5', 'attached_at': '', 'detached_at': '', 'volume_id': '3cb9f515-cb6e-4822-8208-4bd6694ad020', 'serial': '3cb9f515-cb6e-4822-8208-4bd6694ad020'}, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'd1a552ff-c3ac-4fff-b980-de2612e82e76', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77', 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1b0b898b-40b8-40fe-84eb-0361ea0aaf77', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a686feac-bebe-47c8-a3c8-f3c2260ca7f5', 'attached_at': '', 'detached_at': '', 'volume_id': '1b0b898b-40b8-40fe-84eb-0361ea0aaf77', 'serial': '1b0b898b-40b8-40fe-84eb-0361ea0aaf77'}, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 1, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': 'bbb89cef-13ef-485b-a895-41272582206a', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4', 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f6728418-9234-41c7-befe-b38ee3265ba4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'a686feac-bebe-47c8-a3c8-f3c2260ca7f5', 'attached_at': '', 'detached_at': '', 'volume_id': 'f6728418-9234-41c7-befe-b38ee3265ba4', 'serial': 'f6728418-9234-41c7-befe-b38ee3265ba4'}, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 2, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'attachment_id': '3fdbb2a5-d3cd-4aa1-91fa-0f5c07bdd184', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:37:25.282365 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7e1feb4f-8eec-4501-b378-8108453d1c79 req-ede4b993-e263-419f-aafc-9ac067b96bf8 service nova] Acquired lock "refresh_cache-a686feac-bebe-47c8-a3c8-f3c2260ca7f5" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:25.282635 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-7e1feb4f-8eec-4501-b378-8108453d1c79 req-ede4b993-e263-419f-aafc-9ac067b96bf8 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Refreshing network info cache for port 4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:37:25.284907 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:37:25.286152 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-589050877', uuid='a686feac-bebe-47c8-a3c8-f3c2260ca7f5'), owner=OwnerMeta(userid='8a089dde66194b5b967cb79918aa1a33', username='tempest-TaggedBootDevicesTest-1397657593-project-member', projectid='93df6885279b4537969fc0d1beb9f198', projectname='tempest-TaggedBootDevicesTest-1397657593'), image=ImageMeta(id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "38973918-1218-4531-8941-0e9fbff30e3e", "address": "fa:16:3e:98:a5:6d", "network": {"id": "cc7daed3-e035-41b4-99f9-fb4b79e0045d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1956118171-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38973918-12", "ovs_interfaceid": "38973918-1218-4531-8941-0e9fbff30e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "99b479ce-38b6-464c-a476-7039543e31d9", "address": "fa:16:3e:9b:2a:95", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b479ce-38", "ovs_interfaceid": "99b479ce-38b6-464c-a476-7039543e31d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a8a13bff-3694-4c1e-a5ae-486d72b71662", "address": "fa:16:3e:0d:e8:58", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a13bff-36", "ovs_interfaceid": "a8a13bff-3694-4c1e-a5ae-486d72b71662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f141a8bb-5a71-4872-b62f-9fce6052875a", "address": "fa:16:3e:89:3b:98", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf141a8bb-5a", "ovs_interfaceid": "f141a8bb-5a71-4872-b62f-9fce6052875a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa54a649-79c1-4413-91b2-680216f8b045", "address": "fa:16:3e:4e:45:ca", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa54a649-79", "ovs_interfaceid": "fa54a649-79c1-4413-91b2-680216f8b045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a", "address": "fa:16:3e:fc:62:66", "network": {"id": "35589be9-ff77-40f5-8d6f-20e36bb2cd03", "bridge": "br-int", "label": "tempest-device-tagging-net2-1172567199", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0f4a94-bf", "ovs_interfaceid": "4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "53ab7bb3-88bd-4061-9d43-b6392e20c003", "address": "fa:16:3e:50:56:3a", "network": {"id": "35589be9-ff77-40f5-8d6f-20e36bb2cd03", "bridge": "br-int", "label": "tempest-device-tagging-net2-1172567199", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ab7bb3-88", "ovs_interfaceid": "53ab7bb3-88bd-4061-9d43-b6392e20c003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470245.2857263) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:37:25.286984 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:37:25.287375 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:37:25.287948 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:37:25.288157 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:37:25.288884 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:37:25.289208 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:37:25.289381 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:37:25.289501 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:37:25.289659 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:37:25.289795 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:37:25.289929 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:37:25.290127 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:37:25.290255 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:37:25.290415 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:37:25.290559 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:37:25.290719 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:37:25.301604 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Calling os-brick to attach iSCSI Volume {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 26 10:37:25.301938 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020', 'iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3cb9f515-cb6e-4822-8208-4bd6694ad020', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:37:25.302142 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:37:25.302568 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:37:25.303033 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020', 'iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3cb9f515-cb6e-4822-8208-4bd6694ad020', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 10:37:25.317316 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:37:25.318037 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:37:25.318626 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:37:25.318937 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:37:25.319491 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:37:25.319762 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:37:25.333086 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:37:25.333086 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:25.343664 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:37:25.343664 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:25.352090 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020] added Jun 26 10:37:25.352090 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:37:25.352090 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:37:25.352090 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:37:25.352090 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:37:25.352090 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:37:25.352090 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:25.352090 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:37:25.352090 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.031(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:37:25.352090 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:37:25.356669 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020] added Jun 26 10:37:25.356669 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:37:25.356669 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:37:25.356669 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:37:25.356669 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:37:25.356669 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:37:25.356669 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:25.357424 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:37:25.357424 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0373(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:37:25.357424 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:37:25.369618 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:25.527077 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Creating config drive at /opt/stack/data/nova/instances/4b4a4a7e-d584-427e-91d2-7d9e710ea2a3/disk.config Jun 26 10:37:25.531231 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/4b4a4a7e-d584-427e-91d2-7d9e710ea2a3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp45wz4e0e {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:25.569399 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/4b4a4a7e-d584-427e-91d2-7d9e710ea2a3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp45wz4e0e" returned: 0 in 0.038s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:25.680692 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:25.723471 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Acquiring lock "78222936-8bdc-4928-a30e-924af89fd8b9" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:25.723471 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Lock "78222936-8bdc-4928-a30e-924af89fd8b9" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:25.788270 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-7e1feb4f-8eec-4501-b378-8108453d1c79 req-ede4b993-e263-419f-aafc-9ac067b96bf8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:26.040319 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:26.066885 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:26.071485 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:26.169039 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:26.231790 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-7e1feb4f-8eec-4501-b378-8108453d1c79 req-ede4b993-e263-419f-aafc-9ac067b96bf8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:26.233269 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Starting instance... {{(pid=98967) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 26 10:37:26.242911 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:26.246685 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:26.350562 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:37:26.358388 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.50.100 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:37:26.367318 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:26.376903 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b5658677-405f-42e9-bbd4-e928e2fa74f5 req-a2ca5bef-11b6-452f-9f99-1a3300dde878 service nova] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Received event network-vif-plugged-09c4d8fd-840e-4d7a-98c9-f3422893bbba {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:26.376903 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b5658677-405f-42e9-bbd4-e928e2fa74f5 req-a2ca5bef-11b6-452f-9f99-1a3300dde878 service nova] Acquiring lock "4b4a4a7e-d584-427e-91d2-7d9e710ea2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:26.376903 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b5658677-405f-42e9-bbd4-e928e2fa74f5 req-a2ca5bef-11b6-452f-9f99-1a3300dde878 service nova] Lock "4b4a4a7e-d584-427e-91d2-7d9e710ea2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:26.376903 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b5658677-405f-42e9-bbd4-e928e2fa74f5 req-a2ca5bef-11b6-452f-9f99-1a3300dde878 service nova] Lock "4b4a4a7e-d584-427e-91d2-7d9e710ea2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:26.376903 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b5658677-405f-42e9-bbd4-e928e2fa74f5 req-a2ca5bef-11b6-452f-9f99-1a3300dde878 service nova] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Processing event network-vif-plugged-09c4d8fd-840e-4d7a-98c9-f3422893bbba {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.40.100 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:37:26.378229 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:26.385443 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:26.395522 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:26.403177 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:26.403177 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:26.403177 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:26.403423 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:26.403423 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:26.403423 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:26.415317 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:26.415317 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:26.415317 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:26.415317 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:26.415317 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:26.415317 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:26.454244 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020, portal: 192.168.50.100,3260] Jun 26 10:37:26.454244 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020, portal: 192.168.50.100,3260] successful. Jun 26 10:37:26.454244 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:26.467614 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:26.469653 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020, portal: 192.168.40.100,3260] Jun 26 10:37:26.469653 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020, portal: 192.168.40.100,3260] successful. Jun 26 10:37:26.469653 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:26.487310 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:26.487310 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:26.487310 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:26.487310 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:26.487310 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:26.487310 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:26.487310 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:26.487310 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:26.487310 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:26.487310 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:26.487310 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:37:26.487310 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Connected to 192.168.50.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:37:26.487310 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] HCTL ('9', '-', '-', 0) found on session 6 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:37:26.487310 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:37:26.488729 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:26.520022 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Searching for a device in session 6 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:37:26.520022 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3cb9f515-cb6e-4822-8208-4bd6694ad020', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:37:26.525112 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:26.525112 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:26.525112 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:26.525112 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:26.525112 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:26.525294 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:26.525294 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:26.525294 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:26.525294 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:26.525294 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:26.525781 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.206s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:37:26.525781 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Connected to 192.168.40.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:37:26.526510 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] HCTL ('10', '-', '-', 0) found on session 7 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:37:26.526568 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:37:26.557961 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Searching for a device in session 7 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:37:26.557961 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3cb9f515-cb6e-4822-8208-4bd6694ad020', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:37:26.564210 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-7e1feb4f-8eec-4501-b378-8108453d1c79 req-ede4b993-e263-419f-aafc-9ac067b96bf8 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Updated VIF entry in instance network info cache for port 4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:37:26.564210 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-7e1feb4f-8eec-4501-b378-8108453d1c79 req-ede4b993-e263-419f-aafc-9ac067b96bf8 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Updating instance_info_cache with network_info: [{"id": "38973918-1218-4531-8941-0e9fbff30e3e", "address": "fa:16:3e:98:a5:6d", "network": {"id": "cc7daed3-e035-41b4-99f9-fb4b79e0045d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1956118171-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38973918-12", "ovs_interfaceid": "38973918-1218-4531-8941-0e9fbff30e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "99b479ce-38b6-464c-a476-7039543e31d9", "address": "fa:16:3e:9b:2a:95", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b479ce-38", "ovs_interfaceid": "99b479ce-38b6-464c-a476-7039543e31d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a8a13bff-3694-4c1e-a5ae-486d72b71662", "address": "fa:16:3e:0d:e8:58", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a13bff-36", "ovs_interfaceid": "a8a13bff-3694-4c1e-a5ae-486d72b71662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f141a8bb-5a71-4872-b62f-9fce6052875a", "address": "fa:16:3e:89:3b:98", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf141a8bb-5a", "ovs_interfaceid": "f141a8bb-5a71-4872-b62f-9fce6052875a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa54a649-79c1-4413-91b2-680216f8b045", "address": "fa:16:3e:4e:45:ca", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa54a649-79", "ovs_interfaceid": "fa54a649-79c1-4413-91b2-680216f8b045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a", "address": "fa:16:3e:fc:62:66", "network": {"id": "35589be9-ff77-40f5-8d6f-20e36bb2cd03", "bridge": "br-int", "label": "tempest-device-tagging-net2-1172567199", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0f4a94-bf", "ovs_interfaceid": "4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "53ab7bb3-88bd-4061-9d43-b6392e20c003", "address": "fa:16:3e:50:56:3a", "network": {"id": "35589be9-ff77-40f5-8d6f-20e36bb2cd03", "bridge": "br-int", "label": "tempest-device-tagging-net2-1172567199", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ab7bb3-88", "ovs_interfaceid": "53ab7bb3-88bd-4061-9d43-b6392e20c003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:26.826176 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:26.826475 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:26.832082 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98967) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 26 10:37:26.832259 np0000003731 nova-compute[98967]: INFO nova.compute.claims [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Claim successful on node np0000003731 Jun 26 10:37:27.068594 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7e1feb4f-8eec-4501-b378-8108453d1c79 req-ede4b993-e263-419f-aafc-9ac067b96bf8 service nova] Releasing lock "refresh_cache-a686feac-bebe-47c8-a3c8-f3c2260ca7f5" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:27.069023 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-74233eda-76d3-4bec-8431-c59fba84be68 req-06b0fd85-a17d-4262-86a7-5ad5f3a5f51c service nova] Acquired lock "refresh_cache-a686feac-bebe-47c8-a3c8-f3c2260ca7f5" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:27.069203 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-74233eda-76d3-4bec-8431-c59fba84be68 req-06b0fd85-a17d-4262-86a7-5ad5f3a5f51c service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Refreshing network info cache for port 53ab7bb3-88bd-4061-9d43-b6392e20c003 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:37:27.145423 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:27.145423 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] VM Started (Lifecycle Event) Jun 26 10:37:27.146782 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:37:27.150734 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Guest created on hypervisor {{(pid=98967) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 26 10:37:27.153681 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Instance spawned successfully. Jun 26 10:37:27.154269 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 26 10:37:27.319888 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 26 10:37:27.370291 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:27.571840 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-74233eda-76d3-4bec-8431-c59fba84be68 req-06b0fd85-a17d-4262-86a7-5ad5f3a5f51c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:27.651016 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:27.652454 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:37:27.662108 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Found default for hw_cdrom_bus of ide {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:27.662290 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Found default for hw_disk_bus of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:27.662751 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Found default for hw_input_bus of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:27.663111 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Found default for hw_pointer_model of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:27.663455 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Found default for hw_video_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:27.663760 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Found default for hw_vif_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:27.931094 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-74233eda-76d3-4bec-8431-c59fba84be68 req-06b0fd85-a17d-4262-86a7-5ad5f3a5f51c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:28.097138 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-74233eda-76d3-4bec-8431-c59fba84be68 req-06b0fd85-a17d-4262-86a7-5ad5f3a5f51c service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Updated VIF entry in instance network info cache for port 53ab7bb3-88bd-4061-9d43-b6392e20c003. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:37:28.097792 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-74233eda-76d3-4bec-8431-c59fba84be68 req-06b0fd85-a17d-4262-86a7-5ad5f3a5f51c service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Updating instance_info_cache with network_info: [{"id": "38973918-1218-4531-8941-0e9fbff30e3e", "address": "fa:16:3e:98:a5:6d", "network": {"id": "cc7daed3-e035-41b4-99f9-fb4b79e0045d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1956118171-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38973918-12", "ovs_interfaceid": "38973918-1218-4531-8941-0e9fbff30e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "99b479ce-38b6-464c-a476-7039543e31d9", "address": "fa:16:3e:9b:2a:95", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b479ce-38", "ovs_interfaceid": "99b479ce-38b6-464c-a476-7039543e31d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a8a13bff-3694-4c1e-a5ae-486d72b71662", "address": "fa:16:3e:0d:e8:58", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a13bff-36", "ovs_interfaceid": "a8a13bff-3694-4c1e-a5ae-486d72b71662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f141a8bb-5a71-4872-b62f-9fce6052875a", "address": "fa:16:3e:89:3b:98", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf141a8bb-5a", "ovs_interfaceid": "f141a8bb-5a71-4872-b62f-9fce6052875a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa54a649-79c1-4413-91b2-680216f8b045", "address": "fa:16:3e:4e:45:ca", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa54a649-79", "ovs_interfaceid": "fa54a649-79c1-4413-91b2-680216f8b045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a", "address": "fa:16:3e:fc:62:66", "network": {"id": "35589be9-ff77-40f5-8d6f-20e36bb2cd03", "bridge": "br-int", "label": "tempest-device-tagging-net2-1172567199", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0f4a94-bf", "ovs_interfaceid": "4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "53ab7bb3-88bd-4061-9d43-b6392e20c003", "address": "fa:16:3e:50:56:3a", "network": {"id": "35589be9-ff77-40f5-8d6f-20e36bb2cd03", "bridge": "br-int", "label": "tempest-device-tagging-net2-1172567199", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ab7bb3-88", "ovs_interfaceid": "53ab7bb3-88bd-4061-9d43-b6392e20c003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:28.155375 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] During sync_power_state the instance has a pending task (spawning). Skip. Jun 26 10:37:28.155631 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Paused> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:28.155754 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] VM Paused (Lifecycle Event) Jun 26 10:37:28.176061 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Took 6.88 seconds to spawn the instance on the hypervisor. Jun 26 10:37:28.176061 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:28.336611 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Found WWN 330000000e12a8a8b for multipath device dm-3 {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 26 10:37:28.336988 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.034s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:37:28.337258 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] <== connect_volume: return (3035ms) {'type': 'block', 'scsi_wwn': '330000000e12a8a8b', 'path': '/dev/dm-3', 'multipath_id': '330000000e12a8a8b'} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:37:28.337451 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e12a8a8b', 'path': '/dev/dm-3', 'multipath_id': '330000000e12a8a8b'} {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 26 10:37:28.342236 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:28.390387 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:37:28.390603 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:37:28.441094 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-98734377-bd39-46fa-bf13-11f7142d92e9 req-17fd758a-70aa-49e6-8f89-bd8058f39a58 service nova] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Received event network-vif-plugged-09c4d8fd-840e-4d7a-98c9-f3422893bbba {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:28.441094 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-98734377-bd39-46fa-bf13-11f7142d92e9 req-17fd758a-70aa-49e6-8f89-bd8058f39a58 service nova] Acquiring lock "4b4a4a7e-d584-427e-91d2-7d9e710ea2a3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:28.441094 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-98734377-bd39-46fa-bf13-11f7142d92e9 req-17fd758a-70aa-49e6-8f89-bd8058f39a58 service nova] Lock "4b4a4a7e-d584-427e-91d2-7d9e710ea2a3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:28.441648 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-98734377-bd39-46fa-bf13-11f7142d92e9 req-17fd758a-70aa-49e6-8f89-bd8058f39a58 service nova] Lock "4b4a4a7e-d584-427e-91d2-7d9e710ea2a3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:28.441648 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-98734377-bd39-46fa-bf13-11f7142d92e9 req-17fd758a-70aa-49e6-8f89-bd8058f39a58 service nova] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] No waiting events found dispatching network-vif-plugged-09c4d8fd-840e-4d7a-98c9-f3422893bbba {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:37:28.441648 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-98734377-bd39-46fa-bf13-11f7142d92e9 req-17fd758a-70aa-49e6-8f89-bd8058f39a58 service nova] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Received unexpected event network-vif-plugged-09c4d8fd-840e-4d7a-98c9-f3422893bbba for instance with vm_state active and task_state None. Jun 26 10:37:28.600153 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-74233eda-76d3-4bec-8431-c59fba84be68 req-06b0fd85-a17d-4262-86a7-5ad5f3a5f51c service nova] Releasing lock "refresh_cache-a686feac-bebe-47c8-a3c8-f3c2260ca7f5" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:28.659129 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:28.662466 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:28.662661 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] VM Resumed (Lifecycle Event) Jun 26 10:37:28.688753 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Took 14.08 seconds to build instance. Jun 26 10:37:28.848948 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Calling os-brick to attach iSCSI Volume {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 26 10:37:28.849293 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77', 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1b0b898b-40b8-40fe-84eb-0361ea0aaf77', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:37:28.849468 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:37:28.849803 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:37:28.850011 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77', 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1b0b898b-40b8-40fe-84eb-0361ea0aaf77', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 10:37:28.864896 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:37:28.864896 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:37:28.865341 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:37:28.865771 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:37:28.866611 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:37:28.867662 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:37:28.877371 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:37:28.877371 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:28.883070 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:37:28.883070 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:28.889542 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77] added Jun 26 10:37:28.889542 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:37:28.889542 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:37:28.889542 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:37:28.889542 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:37:28.889542 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:37:28.889542 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:28.889984 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:37:28.889984 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0249(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:37:28.889984 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:37:28.893220 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:37:28.899128 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77] added Jun 26 10:37:28.899128 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:37:28.899128 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:37:28.899128 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:37:28.899128 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:37:28.899128 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:37:28.899128 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:28.899128 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:37:28.899757 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0325(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:37:28.900673 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:37:29.167199 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:29.169060 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:37:29.190494 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0891a590-5b5c-4358-8972-68614339e1ba tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "4b4a4a7e-d584-427e-91d2-7d9e710ea2a3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.594s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:29.408132 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.581s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:29.408578 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Start building networks asynchronously for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 26 10:37:29.890451 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:37:29.902167 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.40.100 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:37:29.903990 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.50.100 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:37:29.915941 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:29.923774 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Allocating IP information in the background. {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 26 10:37:29.924150 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] allocate_for_instance() {{(pid=98967) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 26 10:37:29.924721 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:29.925083 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:29.927839 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:29.928636 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:29.946509 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:29.946509 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:29.946509 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:29.946509 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:29.946509 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:29.946777 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:29.946777 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:29.946777 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:29.946777 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:29.946777 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:29.952199 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:29.952199 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:29.952199 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:29.952199 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:29.952199 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:29.952556 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:29.952556 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:29.952556 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:29.952556 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:29.952556 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:29.986807 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77, portal: 192.168.40.100,3260] Jun 26 10:37:29.986807 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77, portal: 192.168.40.100,3260] successful. Jun 26 10:37:29.986807 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:29.992108 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77, portal: 192.168.50.100,3260] Jun 26 10:37:29.992108 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77, portal: 192.168.50.100,3260] successful. Jun 26 10:37:29.992108 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:30.010160 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:30.019303 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:30.026369 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:30.026369 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:30.026369 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:30.026369 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:30.026369 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:30.026369 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:30.026369 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:30.026711 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:30.026711 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:30.026711 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:30.026711 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:30.026711 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:30.026711 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:30.026711 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:30.026874 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.163s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:37:30.027214 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Connected to 192.168.40.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:37:30.027951 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] HCTL ('11', '-', '-', 0) found on session 8 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:37:30.028109 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:37:30.038248 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:30.038248 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:30.038248 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:30.038248 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:30.038248 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:30.038248 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:30.038248 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:30.038568 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:30.038568 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:30.038568 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:30.038568 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:30.038568 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:30.038568 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:30.038568 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:30.038768 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.172s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:37:30.038879 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Connected to 192.168.50.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:37:30.040502 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] HCTL ('12', '-', '-', 0) found on session 9 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:37:30.040502 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:37:30.055491 np0000003731 nova-compute[98967]: DEBUG nova.policy [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3267390b3bbf4307a3a2f1586f14cc87', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57cde3a05e524fd5a92d89589351db78', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98967) authorize /opt/stack/nova/nova/policy.py:192}} Jun 26 10:37:30.060087 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Searching for a device in session 8 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:37:30.060087 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1b0b898b-40b8-40fe-84eb-0361ea0aaf77', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:37:30.060677 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Searching for a device in session 9 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:37:30.061252 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1b0b898b-40b8-40fe-84eb-0361ea0aaf77', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:37:30.179200 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005198329999984708 future=) submitted to {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:37:30.179679 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [-] Emitting event Stopped> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:30.179957 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:37:30.180825 np0000003731 nova-compute[98967]: INFO nova.compute.manager [-] [instance: d48c4183-618a-4abc-9d4c-956576c74490] VM Stopped (Lifecycle Event) Jun 26 10:37:30.425223 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 26 10:37:30.494887 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-9d483b86-f9e7-414b-ab96-8075ac2cf424 req-f5b6a623-04b7-45d2-83c8-ef0e3745bc95 service nova] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Received event network-changed-09c4d8fd-840e-4d7a-98c9-f3422893bbba {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:30.498047 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-9d483b86-f9e7-414b-ab96-8075ac2cf424 req-f5b6a623-04b7-45d2-83c8-ef0e3745bc95 service nova] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Refreshing instance network info cache due to event network-changed-09c4d8fd-840e-4d7a-98c9-f3422893bbba. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:37:30.498232 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-9d483b86-f9e7-414b-ab96-8075ac2cf424 req-f5b6a623-04b7-45d2-83c8-ef0e3745bc95 service nova] Acquiring lock "refresh_cache-4b4a4a7e-d584-427e-91d2-7d9e710ea2a3" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:30.498364 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-9d483b86-f9e7-414b-ab96-8075ac2cf424 req-f5b6a623-04b7-45d2-83c8-ef0e3745bc95 service nova] Acquired lock "refresh_cache-4b4a4a7e-d584-427e-91d2-7d9e710ea2a3" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:30.498494 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-9d483b86-f9e7-414b-ab96-8075ac2cf424 req-f5b6a623-04b7-45d2-83c8-ef0e3745bc95 service nova] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Refreshing network info cache for port 09c4d8fd-840e-4d7a-98c9-f3422893bbba {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:37:30.686337 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-2a7ec15e-2255-425e-adda-91b818022beb None None] [instance: d48c4183-618a-4abc-9d4c-956576c74490] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:30.713349 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Successfully created port: c82a5e66-4de5-45f5-aa1f-23cf9fb96c74 {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:37:30.867281 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 26 10:37:30.929542 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Start building block device mappings for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 26 10:37:31.000643 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-9d483b86-f9e7-414b-ab96-8075ac2cf424 req-f5b6a623-04b7-45d2-83c8-ef0e3745bc95 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:31.352417 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Successfully updated port: c82a5e66-4de5-45f5-aa1f-23cf9fb96c74 {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:37:31.413028 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-ce000688-44c5-4695-a0f8-4980d8b7c2fb req-fe1e5076-f476-49d5-acc3-760f93838737 service nova] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Received event network-changed-c82a5e66-4de5-45f5-aa1f-23cf9fb96c74 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:31.413624 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-ce000688-44c5-4695-a0f8-4980d8b7c2fb req-fe1e5076-f476-49d5-acc3-760f93838737 service nova] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Refreshing instance network info cache due to event network-changed-c82a5e66-4de5-45f5-aa1f-23cf9fb96c74. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:37:31.413995 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-ce000688-44c5-4695-a0f8-4980d8b7c2fb req-fe1e5076-f476-49d5-acc3-760f93838737 service nova] Acquiring lock "refresh_cache-78222936-8bdc-4928-a30e-924af89fd8b9" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:31.415276 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-ce000688-44c5-4695-a0f8-4980d8b7c2fb req-fe1e5076-f476-49d5-acc3-760f93838737 service nova] Acquired lock "refresh_cache-78222936-8bdc-4928-a30e-924af89fd8b9" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:31.415276 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-ce000688-44c5-4695-a0f8-4980d8b7c2fb req-fe1e5076-f476-49d5-acc3-760f93838737 service nova] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Refreshing network info cache for port c82a5e66-4de5-45f5-aa1f-23cf9fb96c74 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:37:31.432582 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-9d483b86-f9e7-414b-ab96-8075ac2cf424 req-f5b6a623-04b7-45d2-83c8-ef0e3745bc95 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:31.597629 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-9d483b86-f9e7-414b-ab96-8075ac2cf424 req-f5b6a623-04b7-45d2-83c8-ef0e3745bc95 service nova] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Updated VIF entry in instance network info cache for port 09c4d8fd-840e-4d7a-98c9-f3422893bbba. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:37:31.597925 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-9d483b86-f9e7-414b-ab96-8075ac2cf424 req-f5b6a623-04b7-45d2-83c8-ef0e3745bc95 service nova] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Updating instance_info_cache with network_info: [{"id": "09c4d8fd-840e-4d7a-98c9-f3422893bbba", "address": "fa:16:3e:5e:04:59", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c4d8fd-84", "ovs_interfaceid": "09c4d8fd-840e-4d7a-98c9-f3422893bbba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:31.816149 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:31.855234 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Acquiring lock "refresh_cache-78222936-8bdc-4928-a30e-924af89fd8b9" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:31.884097 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Found WWN 3300000007bcfada4 for multipath device dm-6 {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 26 10:37:31.884477 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:37:31.884659 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] <== connect_volume: return (3034ms) {'type': 'block', 'scsi_wwn': '3300000007bcfada4', 'path': '/dev/dm-6', 'multipath_id': '3300000007bcfada4'} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:37:31.884884 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007bcfada4', 'path': '/dev/dm-6', 'multipath_id': '3300000007bcfada4'} {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 26 10:37:31.916929 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-ce000688-44c5-4695-a0f8-4980d8b7c2fb req-fe1e5076-f476-49d5-acc3-760f93838737 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:31.945671 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Start spawning the instance on the hypervisor. {{(pid=98967) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 26 10:37:31.945671 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Creating instance directory {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 26 10:37:31.945671 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Creating image(s) Jun 26 10:37:31.945671 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Acquiring lock "/opt/stack/data/nova/instances/78222936-8bdc-4928-a30e-924af89fd8b9/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:31.945671 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Lock "/opt/stack/data/nova/instances/78222936-8bdc-4928-a30e-924af89fd8b9/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:31.946113 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Lock "/opt/stack/data/nova/instances/78222936-8bdc-4928-a30e-924af89fd8b9/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:31.946797 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:31.952192 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:31.954632 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:32.038546 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.084s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:32.039239 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Acquiring lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:32.043033 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:32.043033 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:32.046228 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:32.046813 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:32.063959 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-ce000688-44c5-4695-a0f8-4980d8b7c2fb req-fe1e5076-f476-49d5-acc3-760f93838737 service nova] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:37:32.101619 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-9d483b86-f9e7-414b-ab96-8075ac2cf424 req-f5b6a623-04b7-45d2-83c8-ef0e3745bc95 service nova] Releasing lock "refresh_cache-4b4a4a7e-d584-427e-91d2-7d9e710ea2a3" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:32.122129 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.075s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:32.128453 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/78222936-8bdc-4928-a30e-924af89fd8b9/disk 1073741824 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:32.177842 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/78222936-8bdc-4928-a30e-924af89fd8b9/disk 1073741824" returned: 0 in 0.054s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:32.178505 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.138s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:32.178968 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:32.260069 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.076s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:32.260069 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Checking if we can resize image /opt/stack/data/nova/instances/78222936-8bdc-4928-a30e-924af89fd8b9/disk. size=1073741824 {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 26 10:37:32.260069 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78222936-8bdc-4928-a30e-924af89fd8b9/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:32.295918 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-ce000688-44c5-4695-a0f8-4980d8b7c2fb req-fe1e5076-f476-49d5-acc3-760f93838737 service nova] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:32.321857 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/78222936-8bdc-4928-a30e-924af89fd8b9/disk --force-share --output=json" returned: 0 in 0.065s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:32.322345 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Cannot resize image /opt/stack/data/nova/instances/78222936-8bdc-4928-a30e-924af89fd8b9/disk to a smaller size. {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 26 10:37:32.322673 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Created local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 26 10:37:32.322892 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Ensure instance console log exists: /opt/stack/data/nova/instances/78222936-8bdc-4928-a30e-924af89fd8b9/console.log {{(pid=98967) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 26 10:37:32.323194 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:32.323444 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:32.323614 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:32.373967 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:32.393277 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Calling os-brick to attach iSCSI Volume {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 26 10:37:32.393674 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4', 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f6728418-9234-41c7-befe-b38ee3265ba4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:37:32.393851 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:37:32.396996 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:37:32.396996 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4', 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f6728418-9234-41c7-befe-b38ee3265ba4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 10:37:32.406424 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:37:32.407031 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:37:32.407642 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:37:32.408046 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:37:32.408298 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:37:32.408560 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:37:32.419573 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:37:32.419573 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:32.421381 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:37:32.421381 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:32.433706 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4] added Jun 26 10:37:32.433706 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:37:32.433706 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:37:32.433706 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:37:32.433706 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:37:32.433706 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:37:32.433706 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:32.433982 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:37:32.434125 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0258(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:37:32.434304 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:37:32.437287 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4] added Jun 26 10:37:32.437287 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:37:32.437287 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:37:32.437287 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:37:32.437287 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:37:32.437287 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:37:32.437287 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:32.437572 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:37:32.437660 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0297(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:37:32.437795 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:37:32.773352 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "212147b0-26de-42cd-b43d-057ec8d61c72" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:32.773570 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "212147b0-26de-42cd-b43d-057ec8d61c72" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:32.798554 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-ce000688-44c5-4695-a0f8-4980d8b7c2fb req-fe1e5076-f476-49d5-acc3-760f93838737 service nova] Releasing lock "refresh_cache-78222936-8bdc-4928-a30e-924af89fd8b9" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:32.800064 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Acquired lock "refresh_cache-78222936-8bdc-4928-a30e-924af89fd8b9" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:32.800064 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:37:33.276986 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Starting instance... {{(pid=98967) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 26 10:37:33.345343 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:33.372107 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:37:33.434813 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.40.100 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:37:33.454079 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.50.100 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:37:33.465378 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:33.469109 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:33.480637 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:33.496205 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:33.496205 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:33.496205 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:33.496205 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:33.496205 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:33.496205 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:33.496205 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:33.496545 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:33.496545 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:33.496545 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:33.496545 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:33.496545 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:33.496545 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:33.496545 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:33.505219 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:33.505219 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:33.505219 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:33.505219 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:33.505219 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:33.505219 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:33.505219 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:33.505569 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:33.505569 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:33.505569 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:33.505569 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:33.505569 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:33.505569 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:33.505569 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:33.541785 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4, portal: 192.168.40.100,3260] Jun 26 10:37:33.541785 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4, portal: 192.168.40.100,3260] successful. Jun 26 10:37:33.541785 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:33.552333 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4, portal: 192.168.50.100,3260] Jun 26 10:37:33.552333 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4, portal: 192.168.50.100,3260] successful. Jun 26 10:37:33.552333 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:33.565308 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:33.566443 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:33.584812 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:33.584812 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:33.584812 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:33.584812 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:33.584812 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:33.584812 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:33.584812 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:33.584812 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:33.584812 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:33.587709 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:33.589671 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:33.589671 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:33.589671 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:33.589671 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:33.589671 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:33.589671 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:33.589671 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:33.589671 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:33.589671 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:33.590564 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:33.590564 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:33.590564 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:33.590564 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:33.590564 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:33.590564 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:33.590564 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:33.590564 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:33.590564 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:33.590881 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:33.590881 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:33.590881 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:33.590881 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:33.590881 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:33.590881 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:33.590881 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:33.590881 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:33.590881 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:33.591780 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.184s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:37:33.591780 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Connected to 192.168.50.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:37:33.592218 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.183s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:37:33.592451 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Connected to 192.168.40.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:37:33.593521 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] HCTL ('14', '-', '-', 0) found on session 11 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:37:33.593646 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:37:33.594593 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] HCTL ('13', '-', '-', 0) found on session 10 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:37:33.594830 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:37:33.618233 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Searching for a device in session 11 and hctl ['14', '*', '*', 0] yield: sdh {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:37:33.618233 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f6728418-9234-41c7-befe-b38ee3265ba4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:37:33.621418 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Searching for a device in session 10 and hctl ['13', '*', '*', 0] yield: sdi {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:37:33.621616 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f6728418-9234-41c7-befe-b38ee3265ba4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:37:33.833023 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Updating instance_info_cache with network_info: [{"id": "c82a5e66-4de5-45f5-aa1f-23cf9fb96c74", "address": "fa:16:3e:85:f9:31", "network": {"id": "5aba4cc4-933f-443e-a572-58eeebc7a665", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-142224289-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57cde3a05e524fd5a92d89589351db78", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82a5e66-4d", "ovs_interfaceid": "c82a5e66-4de5-45f5-aa1f-23cf9fb96c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:33.852749 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:33.852749 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:33.852749 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98967) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 26 10:37:33.852749 np0000003731 nova-compute[98967]: INFO nova.compute.claims [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Claim successful on node np0000003731 Jun 26 10:37:33.919743 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:34.339152 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Releasing lock "refresh_cache-78222936-8bdc-4928-a30e-924af89fd8b9" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:34.339379 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Instance network_info: |[{"id": "c82a5e66-4de5-45f5-aa1f-23cf9fb96c74", "address": "fa:16:3e:85:f9:31", "network": {"id": "5aba4cc4-933f-443e-a572-58eeebc7a665", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-142224289-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57cde3a05e524fd5a92d89589351db78", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82a5e66-4d", "ovs_interfaceid": "c82a5e66-4de5-45f5-aa1f-23cf9fb96c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 26 10:37:34.342166 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Start _get_guest_xml network_info=[{"id": "c82a5e66-4de5-45f5-aa1f-23cf9fb96c74", "address": "fa:16:3e:85:f9:31", "network": {"id": "5aba4cc4-933f-443e-a572-58eeebc7a665", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-142224289-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57cde3a05e524fd5a92d89589351db78", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82a5e66-4d", "ovs_interfaceid": "c82a5e66-4de5-45f5-aa1f-23cf9fb96c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'image_id': 'a9b18127-6fee-4ed6-b364-a2d634ecb8b7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:37:34.353099 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:37:34.354487 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='tempest-VolumesAdminNegativeTest-server-1199412248', uuid='78222936-8bdc-4928-a30e-924af89fd8b9'), owner=OwnerMeta(userid='3267390b3bbf4307a3a2f1586f14cc87', username='tempest-VolumesAdminNegativeTest-1830845743-project-member', projectid='57cde3a05e524fd5a92d89589351db78', projectname='tempest-VolumesAdminNegativeTest-1830845743'), image=ImageMeta(id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "c82a5e66-4de5-45f5-aa1f-23cf9fb96c74", "address": "fa:16:3e:85:f9:31", "network": {"id": "5aba4cc4-933f-443e-a572-58eeebc7a665", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-142224289-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57cde3a05e524fd5a92d89589351db78", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82a5e66-4d", "ovs_interfaceid": "c82a5e66-4de5-45f5-aa1f-23cf9fb96c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470254.354053) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:37:34.360841 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:37:34.361247 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:37:34.364332 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:37:34.364551 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:37:34.365638 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:37:34.366016 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:37:34.371839 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:37:34.371839 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:37:34.371839 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:37:34.371839 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:37:34.371839 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:37:34.371839 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:37:34.371839 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:37:34.371839 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:37:34.371839 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:37:34.371839 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:37:34.390300 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:37:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1199412248',display_name='tempest-VolumesAdminNegativeTest-server-1199412248',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-volumesadminnegativetest-server-1199412248',id=10,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57cde3a05e524fd5a92d89589351db78',ramdisk_id='',reservation_id='r-zuv41j31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1830845743',owner_user_name='tempest-VolumesAdminNegativeTest-1830845743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:31Z,user_data=None,user_id='3267390b3bbf4307a3a2f1586f14cc87',uuid=78222936-8bdc-4928-a30e-924af89fd8b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c82a5e66-4de5-45f5-aa1f-23cf9fb96c74", "address": "fa:16:3e:85:f9:31", "network": {"id": "5aba4cc4-933f-443e-a572-58eeebc7a665", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-142224289-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57cde3a05e524fd5a92d89589351db78", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82a5e66-4d", "ovs_interfaceid": "c82a5e66-4de5-45f5-aa1f-23cf9fb96c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:37:34.390502 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Converting VIF {"id": "c82a5e66-4de5-45f5-aa1f-23cf9fb96c74", "address": "fa:16:3e:85:f9:31", "network": {"id": "5aba4cc4-933f-443e-a572-58eeebc7a665", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-142224289-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57cde3a05e524fd5a92d89589351db78", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82a5e66-4d", "ovs_interfaceid": "c82a5e66-4de5-45f5-aa1f-23cf9fb96c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:34.391122 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:f9:31,bridge_name='br-int',has_traffic_filtering=True,id=c82a5e66-4de5-45f5-aa1f-23cf9fb96c74,network=Network(5aba4cc4-933f-443e-a572-58eeebc7a665),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc82a5e66-4d') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:34.391784 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Lazy-loading 'pci_devices' on Instance uuid 78222936-8bdc-4928-a30e-924af89fd8b9 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:37:34.408748 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] End _get_guest_xml xml= Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: 78222936-8bdc-4928-a30e-924af89fd8b9 Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: instance-0000000a Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: 196608 Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: tempest-VolumesAdminNegativeTest-server-1199412248 Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: 2026-06-26 10:37:34 Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: 192 Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: True Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: bare Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: virtio Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: tempest-VolumesAdminNegativeTest-1830845743-project-member Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: tempest-VolumesAdminNegativeTest-1830845743 Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: 78222936-8bdc-4928-a30e-924af89fd8b9 Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: 78222936-8bdc-4928-a30e-924af89fd8b9 Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: hvm Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: 128 Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: Jun 26 10:37:34.896514 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:37:34.902410 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Preparing to wait for external event network-vif-plugged-c82a5e66-4de5-45f5-aa1f-23cf9fb96c74 {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:37:34.902410 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Acquiring lock "78222936-8bdc-4928-a30e-924af89fd8b9-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:34.902410 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Lock "78222936-8bdc-4928-a30e-924af89fd8b9-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:34.902410 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Lock "78222936-8bdc-4928-a30e-924af89fd8b9-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:34.902410 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:37:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1199412248',display_name='tempest-VolumesAdminNegativeTest-server-1199412248',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-volumesadminnegativetest-server-1199412248',id=10,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='57cde3a05e524fd5a92d89589351db78',ramdisk_id='',reservation_id='r-zuv41j31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-VolumesAdminNegativeTest-1830845743',owner_user_name='tempest-VolumesAdminNegativeTest-1830845743-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:31Z,user_data=None,user_id='3267390b3bbf4307a3a2f1586f14cc87',uuid=78222936-8bdc-4928-a30e-924af89fd8b9,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c82a5e66-4de5-45f5-aa1f-23cf9fb96c74", "address": "fa:16:3e:85:f9:31", "network": {"id": "5aba4cc4-933f-443e-a572-58eeebc7a665", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-142224289-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57cde3a05e524fd5a92d89589351db78", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82a5e66-4d", "ovs_interfaceid": "c82a5e66-4de5-45f5-aa1f-23cf9fb96c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:37:34.902410 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Converting VIF {"id": "c82a5e66-4de5-45f5-aa1f-23cf9fb96c74", "address": "fa:16:3e:85:f9:31", "network": {"id": "5aba4cc4-933f-443e-a572-58eeebc7a665", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-142224289-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57cde3a05e524fd5a92d89589351db78", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82a5e66-4d", "ovs_interfaceid": "c82a5e66-4de5-45f5-aa1f-23cf9fb96c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:34.902410 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:f9:31,bridge_name='br-int',has_traffic_filtering=True,id=c82a5e66-4de5-45f5-aa1f-23cf9fb96c74,network=Network(5aba4cc4-933f-443e-a572-58eeebc7a665),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc82a5e66-4d') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:34.902410 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:f9:31,bridge_name='br-int',has_traffic_filtering=True,id=c82a5e66-4de5-45f5-aa1f-23cf9fb96c74,network=Network(5aba4cc4-933f-443e-a572-58eeebc7a665),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc82a5e66-4d') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:37:34.903328 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:34.903551 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:34.903762 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:37:34.905220 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:34.905485 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7c8ddd23-39da-533f-9e40-1dd51fe9d1b4', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:34.913086 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:34.913908 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:34.915898 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:34.922352 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:34.922605 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc82a5e66-4d, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:34.922954 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc82a5e66-4d, col_values=(('qos', UUID('61d74c00-3db5-4537-9638-7e17e7b17532')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:34.923547 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc82a5e66-4d, col_values=(('external_ids', {'iface-id': 'c82a5e66-4de5-45f5-aa1f-23cf9fb96c74', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:f9:31', 'vm-uuid': '78222936-8bdc-4928-a30e-924af89fd8b9'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:34.925537 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:34.926779 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:34.932145 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:34.933467 np0000003731 nova-compute[98967]: INFO os_vif [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:f9:31,bridge_name='br-int',has_traffic_filtering=True,id=c82a5e66-4de5-45f5-aa1f-23cf9fb96c74,network=Network(5aba4cc4-933f-443e-a572-58eeebc7a665),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc82a5e66-4d') Jun 26 10:37:35.343239 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:37:35.343464 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:37:35.427324 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Found WWN 3300000009ac11a9d for multipath device dm-7 {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 26 10:37:35.427324 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.033s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:37:35.427324 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] <== connect_volume: return (3033ms) {'type': 'block', 'scsi_wwn': '3300000009ac11a9d', 'path': '/dev/dm-7', 'multipath_id': '3300000009ac11a9d'} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:37:35.427324 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009ac11a9d', 'path': '/dev/dm-7', 'multipath_id': '3300000009ac11a9d'} {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 26 10:37:35.845797 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:37:35.931154 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-589050877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-589050877',id=8,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOB2Sn7n/w8UeynSgIX7Pa+jWvACxe6vAPkjQBXv/eHuOpw0qYDCymYoGIWFIQ1K6gbGfZ4Mmn8WWEpLTsNoltBKnNPktYyulDt6E7QX9Q7av35lOxeQlHvrWEPuUtCAkg==',key_name='tempest-keypair-1634372885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93df6885279b4537969fc0d1beb9f198',ramdisk_id='',reservation_id='r-wpod5h0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1397657593',owner_user_name='tempest-TaggedBootDevicesTest-1397657593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a089dde66194b5b967cb79918aa1a33',uuid=a686feac-bebe-47c8-a3c8-f3c2260ca7f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38973918-1218-4531-8941-0e9fbff30e3e", "address": "fa:16:3e:98:a5:6d", "network": {"id": "cc7daed3-e035-41b4-99f9-fb4b79e0045d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1956118171-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38973918-12", "ovs_interfaceid": "38973918-1218-4531-8941-0e9fbff30e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:37:35.934026 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converting VIF {"id": "38973918-1218-4531-8941-0e9fbff30e3e", "address": "fa:16:3e:98:a5:6d", "network": {"id": "cc7daed3-e035-41b4-99f9-fb4b79e0045d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1956118171-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38973918-12", "ovs_interfaceid": "38973918-1218-4531-8941-0e9fbff30e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:35.934026 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:a5:6d,bridge_name='br-int',has_traffic_filtering=True,id=38973918-1218-4531-8941-0e9fbff30e3e,network=Network(cc7daed3-e035-41b4-99f9-fb4b79e0045d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38973918-12') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:35.934026 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-589050877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-589050877',id=8,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOB2Sn7n/w8UeynSgIX7Pa+jWvACxe6vAPkjQBXv/eHuOpw0qYDCymYoGIWFIQ1K6gbGfZ4Mmn8WWEpLTsNoltBKnNPktYyulDt6E7QX9Q7av35lOxeQlHvrWEPuUtCAkg==',key_name='tempest-keypair-1634372885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93df6885279b4537969fc0d1beb9f198',ramdisk_id='',reservation_id='r-wpod5h0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1397657593',owner_user_name='tempest-TaggedBootDevicesTest-1397657593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a089dde66194b5b967cb79918aa1a33',uuid=a686feac-bebe-47c8-a3c8-f3c2260ca7f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99b479ce-38b6-464c-a476-7039543e31d9", "address": "fa:16:3e:9b:2a:95", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b479ce-38", "ovs_interfaceid": "99b479ce-38b6-464c-a476-7039543e31d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:37:35.934026 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converting VIF {"id": "99b479ce-38b6-464c-a476-7039543e31d9", "address": "fa:16:3e:9b:2a:95", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b479ce-38", "ovs_interfaceid": "99b479ce-38b6-464c-a476-7039543e31d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:35.934026 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:2a:95,bridge_name='br-int',has_traffic_filtering=True,id=99b479ce-38b6-464c-a476-7039543e31d9,network=Network(7f72f742-9acd-4d6e-881e-fcc3b2713b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap99b479ce-38') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:35.934754 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-589050877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-589050877',id=8,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOB2Sn7n/w8UeynSgIX7Pa+jWvACxe6vAPkjQBXv/eHuOpw0qYDCymYoGIWFIQ1K6gbGfZ4Mmn8WWEpLTsNoltBKnNPktYyulDt6E7QX9Q7av35lOxeQlHvrWEPuUtCAkg==',key_name='tempest-keypair-1634372885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93df6885279b4537969fc0d1beb9f198',ramdisk_id='',reservation_id='r-wpod5h0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1397657593',owner_user_name='tempest-TaggedBootDevicesTest-1397657593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a089dde66194b5b967cb79918aa1a33',uuid=a686feac-bebe-47c8-a3c8-f3c2260ca7f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8a13bff-3694-4c1e-a5ae-486d72b71662", "address": "fa:16:3e:0d:e8:58", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a13bff-36", "ovs_interfaceid": "a8a13bff-3694-4c1e-a5ae-486d72b71662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:37:35.935151 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converting VIF {"id": "a8a13bff-3694-4c1e-a5ae-486d72b71662", "address": "fa:16:3e:0d:e8:58", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a13bff-36", "ovs_interfaceid": "a8a13bff-3694-4c1e-a5ae-486d72b71662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:35.935849 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:e8:58,bridge_name='br-int',has_traffic_filtering=True,id=a8a13bff-3694-4c1e-a5ae-486d72b71662,network=Network(7f72f742-9acd-4d6e-881e-fcc3b2713b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa8a13bff-36') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:35.938027 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-589050877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-589050877',id=8,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOB2Sn7n/w8UeynSgIX7Pa+jWvACxe6vAPkjQBXv/eHuOpw0qYDCymYoGIWFIQ1K6gbGfZ4Mmn8WWEpLTsNoltBKnNPktYyulDt6E7QX9Q7av35lOxeQlHvrWEPuUtCAkg==',key_name='tempest-keypair-1634372885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93df6885279b4537969fc0d1beb9f198',ramdisk_id='',reservation_id='r-wpod5h0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1397657593',owner_user_name='tempest-TaggedBootDevicesTest-1397657593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a089dde66194b5b967cb79918aa1a33',uuid=a686feac-bebe-47c8-a3c8-f3c2260ca7f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f141a8bb-5a71-4872-b62f-9fce6052875a", "address": "fa:16:3e:89:3b:98", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf141a8bb-5a", "ovs_interfaceid": "f141a8bb-5a71-4872-b62f-9fce6052875a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:37:35.938027 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converting VIF {"id": "f141a8bb-5a71-4872-b62f-9fce6052875a", "address": "fa:16:3e:89:3b:98", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf141a8bb-5a", "ovs_interfaceid": "f141a8bb-5a71-4872-b62f-9fce6052875a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:35.938027 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:3b:98,bridge_name='br-int',has_traffic_filtering=True,id=f141a8bb-5a71-4872-b62f-9fce6052875a,network=Network(7f72f742-9acd-4d6e-881e-fcc3b2713b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf141a8bb-5a') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:35.938027 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-589050877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-589050877',id=8,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOB2Sn7n/w8UeynSgIX7Pa+jWvACxe6vAPkjQBXv/eHuOpw0qYDCymYoGIWFIQ1K6gbGfZ4Mmn8WWEpLTsNoltBKnNPktYyulDt6E7QX9Q7av35lOxeQlHvrWEPuUtCAkg==',key_name='tempest-keypair-1634372885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93df6885279b4537969fc0d1beb9f198',ramdisk_id='',reservation_id='r-wpod5h0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1397657593',owner_user_name='tempest-TaggedBootDevicesTest-1397657593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a089dde66194b5b967cb79918aa1a33',uuid=a686feac-bebe-47c8-a3c8-f3c2260ca7f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa54a649-79c1-4413-91b2-680216f8b045", "address": "fa:16:3e:4e:45:ca", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa54a649-79", "ovs_interfaceid": "fa54a649-79c1-4413-91b2-680216f8b045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:37:35.938027 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converting VIF {"id": "fa54a649-79c1-4413-91b2-680216f8b045", "address": "fa:16:3e:4e:45:ca", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa54a649-79", "ovs_interfaceid": "fa54a649-79c1-4413-91b2-680216f8b045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:35.938027 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:45:ca,bridge_name='br-int',has_traffic_filtering=True,id=fa54a649-79c1-4413-91b2-680216f8b045,network=Network(7f72f742-9acd-4d6e-881e-fcc3b2713b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa54a649-79') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:35.938997 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-589050877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-589050877',id=8,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOB2Sn7n/w8UeynSgIX7Pa+jWvACxe6vAPkjQBXv/eHuOpw0qYDCymYoGIWFIQ1K6gbGfZ4Mmn8WWEpLTsNoltBKnNPktYyulDt6E7QX9Q7av35lOxeQlHvrWEPuUtCAkg==',key_name='tempest-keypair-1634372885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93df6885279b4537969fc0d1beb9f198',ramdisk_id='',reservation_id='r-wpod5h0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1397657593',owner_user_name='tempest-TaggedBootDevicesTest-1397657593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a089dde66194b5b967cb79918aa1a33',uuid=a686feac-bebe-47c8-a3c8-f3c2260ca7f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a", "address": "fa:16:3e:fc:62:66", "network": {"id": "35589be9-ff77-40f5-8d6f-20e36bb2cd03", "bridge": "br-int", "label": "tempest-device-tagging-net2-1172567199", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0f4a94-bf", "ovs_interfaceid": "4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:37:35.939399 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converting VIF {"id": "4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a", "address": "fa:16:3e:fc:62:66", "network": {"id": "35589be9-ff77-40f5-8d6f-20e36bb2cd03", "bridge": "br-int", "label": "tempest-device-tagging-net2-1172567199", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0f4a94-bf", "ovs_interfaceid": "4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:35.939923 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:62:66,bridge_name='br-int',has_traffic_filtering=True,id=4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a,network=Network(35589be9-ff77-40f5-8d6f-20e36bb2cd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d0f4a94-bf') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:35.940860 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-589050877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-589050877',id=8,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOB2Sn7n/w8UeynSgIX7Pa+jWvACxe6vAPkjQBXv/eHuOpw0qYDCymYoGIWFIQ1K6gbGfZ4Mmn8WWEpLTsNoltBKnNPktYyulDt6E7QX9Q7av35lOxeQlHvrWEPuUtCAkg==',key_name='tempest-keypair-1634372885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93df6885279b4537969fc0d1beb9f198',ramdisk_id='',reservation_id='r-wpod5h0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1397657593',owner_user_name='tempest-TaggedBootDevicesTest-1397657593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a089dde66194b5b967cb79918aa1a33',uuid=a686feac-bebe-47c8-a3c8-f3c2260ca7f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53ab7bb3-88bd-4061-9d43-b6392e20c003", "address": "fa:16:3e:50:56:3a", "network": {"id": "35589be9-ff77-40f5-8d6f-20e36bb2cd03", "bridge": "br-int", "label": "tempest-device-tagging-net2-1172567199", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ab7bb3-88", "ovs_interfaceid": "53ab7bb3-88bd-4061-9d43-b6392e20c003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:37:35.942024 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converting VIF {"id": "53ab7bb3-88bd-4061-9d43-b6392e20c003", "address": "fa:16:3e:50:56:3a", "network": {"id": "35589be9-ff77-40f5-8d6f-20e36bb2cd03", "bridge": "br-int", "label": "tempest-device-tagging-net2-1172567199", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ab7bb3-88", "ovs_interfaceid": "53ab7bb3-88bd-4061-9d43-b6392e20c003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:35.942024 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:56:3a,bridge_name='br-int',has_traffic_filtering=True,id=53ab7bb3-88bd-4061-9d43-b6392e20c003,network=Network(35589be9-ff77-40f5-8d6f-20e36bb2cd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ab7bb3-88') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:35.942229 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lazy-loading 'pci_devices' on Instance uuid a686feac-bebe-47c8-a3c8-f3c2260ca7f5 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:37:36.353749 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.506s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:36.354280 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Start building networks asynchronously for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] End _get_guest_xml xml= Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: a686feac-bebe-47c8-a3c8-f3c2260ca7f5 Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: instance-00000008 Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: 196608 Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: tempest-device-tagging-server-589050877 Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: 2026-06-26 10:37:25 Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: 192 Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: True Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: bare Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: virtio Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: tempest-TaggedBootDevicesTest-1397657593-project-member Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: tempest-TaggedBootDevicesTest-1397657593 Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: a686feac-bebe-47c8-a3c8-f3c2260ca7f5 Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: a686feac-bebe-47c8-a3c8-f3c2260ca7f5 Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: hvm Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: 128 Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: 3cb9f515-cb6e-4822-8208-4bd6694ad020 Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: 1b0b898b-40b8-40fe-84eb-0361ea0aaf77 Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: f6728418-9234-41c7-befe-b38ee3265ba4 Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: Jun 26 10:37:36.447398 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:37:36.455217 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Preparing to wait for external event network-vif-plugged-38973918-1218-4531-8941-0e9fbff30e3e {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:37:36.455217 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:36.455217 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:36.455217 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:36.455217 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Preparing to wait for external event network-vif-plugged-99b479ce-38b6-464c-a476-7039543e31d9 {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:37:36.455217 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:36.455217 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:36.455217 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:36.455217 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Preparing to wait for external event network-vif-plugged-a8a13bff-3694-4c1e-a5ae-486d72b71662 {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:37:36.455217 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:36.455217 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:36.455217 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:36.455217 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Preparing to wait for external event network-vif-plugged-f141a8bb-5a71-4872-b62f-9fce6052875a {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:37:36.455217 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:36.455217 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:36.455217 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:36.455217 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Preparing to wait for external event network-vif-plugged-fa54a649-79c1-4413-91b2-680216f8b045 {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:37:36.455217 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:36.455217 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:36.455217 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:36.455217 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Preparing to wait for external event network-vif-plugged-4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:37:36.455217 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:36.455217 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:36.455217 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.004s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:36.455217 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Preparing to wait for external event network-vif-plugged-53ab7bb3-88bd-4061-9d43-b6392e20c003 {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:37:36.455217 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:36.455217 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:36.455217 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:36.457360 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-589050877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-589050877',id=8,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOB2Sn7n/w8UeynSgIX7Pa+jWvACxe6vAPkjQBXv/eHuOpw0qYDCymYoGIWFIQ1K6gbGfZ4Mmn8WWEpLTsNoltBKnNPktYyulDt6E7QX9Q7av35lOxeQlHvrWEPuUtCAkg==',key_name='tempest-keypair-1634372885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93df6885279b4537969fc0d1beb9f198',ramdisk_id='',reservation_id='r-wpod5h0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1397657593',owner_user_name='tempest-TaggedBootDevicesTest-1397657593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a089dde66194b5b967cb79918aa1a33',uuid=a686feac-bebe-47c8-a3c8-f3c2260ca7f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "38973918-1218-4531-8941-0e9fbff30e3e", "address": "fa:16:3e:98:a5:6d", "network": {"id": "cc7daed3-e035-41b4-99f9-fb4b79e0045d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1956118171-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38973918-12", "ovs_interfaceid": "38973918-1218-4531-8941-0e9fbff30e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:37:36.457360 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converting VIF {"id": "38973918-1218-4531-8941-0e9fbff30e3e", "address": "fa:16:3e:98:a5:6d", "network": {"id": "cc7daed3-e035-41b4-99f9-fb4b79e0045d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1956118171-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38973918-12", "ovs_interfaceid": "38973918-1218-4531-8941-0e9fbff30e3e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:36.457360 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:98:a5:6d,bridge_name='br-int',has_traffic_filtering=True,id=38973918-1218-4531-8941-0e9fbff30e3e,network=Network(cc7daed3-e035-41b4-99f9-fb4b79e0045d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38973918-12') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:36.457360 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:a5:6d,bridge_name='br-int',has_traffic_filtering=True,id=38973918-1218-4531-8941-0e9fbff30e3e,network=Network(cc7daed3-e035-41b4-99f9-fb4b79e0045d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38973918-12') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:37:36.457748 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.457848 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.458045 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:37:36.458827 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.459015 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '41512afd-f3ea-55f4-9cbd-2764e3deceea', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.459718 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.460250 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:36.466663 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.470127 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:36.470127 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:36.470127 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] No VIF found with MAC fa:16:3e:85:f9:31, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:37:36.470127 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Using config drive Jun 26 10:37:36.485767 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.485767 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap38973918-12, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.485767 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap38973918-12, col_values=(('qos', UUID('8a4b0c2c-93c1-43c5-a98e-aa7d0fe7fca8')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.485767 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap38973918-12, col_values=(('external_ids', {'iface-id': '38973918-1218-4531-8941-0e9fbff30e3e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:98:a5:6d', 'vm-uuid': 'a686feac-bebe-47c8-a3c8-f3c2260ca7f5'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.485991 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.487207 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:36.496113 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.498681 np0000003731 nova-compute[98967]: INFO os_vif [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:98:a5:6d,bridge_name='br-int',has_traffic_filtering=True,id=38973918-1218-4531-8941-0e9fbff30e3e,network=Network(cc7daed3-e035-41b4-99f9-fb4b79e0045d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38973918-12') Jun 26 10:37:36.498681 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-589050877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-589050877',id=8,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOB2Sn7n/w8UeynSgIX7Pa+jWvACxe6vAPkjQBXv/eHuOpw0qYDCymYoGIWFIQ1K6gbGfZ4Mmn8WWEpLTsNoltBKnNPktYyulDt6E7QX9Q7av35lOxeQlHvrWEPuUtCAkg==',key_name='tempest-keypair-1634372885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93df6885279b4537969fc0d1beb9f198',ramdisk_id='',reservation_id='r-wpod5h0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1397657593',owner_user_name='tempest-TaggedBootDevicesTest-1397657593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a089dde66194b5b967cb79918aa1a33',uuid=a686feac-bebe-47c8-a3c8-f3c2260ca7f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "99b479ce-38b6-464c-a476-7039543e31d9", "address": "fa:16:3e:9b:2a:95", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b479ce-38", "ovs_interfaceid": "99b479ce-38b6-464c-a476-7039543e31d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:37:36.498681 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converting VIF {"id": "99b479ce-38b6-464c-a476-7039543e31d9", "address": "fa:16:3e:9b:2a:95", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b479ce-38", "ovs_interfaceid": "99b479ce-38b6-464c-a476-7039543e31d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:36.498681 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:2a:95,bridge_name='br-int',has_traffic_filtering=True,id=99b479ce-38b6-464c-a476-7039543e31d9,network=Network(7f72f742-9acd-4d6e-881e-fcc3b2713b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap99b479ce-38') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:36.498681 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:2a:95,bridge_name='br-int',has_traffic_filtering=True,id=99b479ce-38b6-464c-a476-7039543e31d9,network=Network(7f72f742-9acd-4d6e-881e-fcc3b2713b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap99b479ce-38') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:37:36.499299 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.499299 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.499299 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:37:36.500229 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.500391 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '34974632-3f18-5422-9bae-a8cca93f8c8f', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.503479 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.504074 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:36.527391 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.529565 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.529713 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap99b479ce-38, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.529987 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap99b479ce-38, col_values=(('qos', UUID('bed22f9f-b69a-4b84-b4da-b8d17bef6cd5')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.530194 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap99b479ce-38, col_values=(('external_ids', {'iface-id': '99b479ce-38b6-464c-a476-7039543e31d9', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9b:2a:95', 'vm-uuid': 'a686feac-bebe-47c8-a3c8-f3c2260ca7f5'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.544794 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.546148 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:36.561979 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.564516 np0000003731 nova-compute[98967]: INFO os_vif [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:2a:95,bridge_name='br-int',has_traffic_filtering=True,id=99b479ce-38b6-464c-a476-7039543e31d9,network=Network(7f72f742-9acd-4d6e-881e-fcc3b2713b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap99b479ce-38') Jun 26 10:37:36.564516 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-589050877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-589050877',id=8,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOB2Sn7n/w8UeynSgIX7Pa+jWvACxe6vAPkjQBXv/eHuOpw0qYDCymYoGIWFIQ1K6gbGfZ4Mmn8WWEpLTsNoltBKnNPktYyulDt6E7QX9Q7av35lOxeQlHvrWEPuUtCAkg==',key_name='tempest-keypair-1634372885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93df6885279b4537969fc0d1beb9f198',ramdisk_id='',reservation_id='r-wpod5h0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1397657593',owner_user_name='tempest-TaggedBootDevicesTest-1397657593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a089dde66194b5b967cb79918aa1a33',uuid=a686feac-bebe-47c8-a3c8-f3c2260ca7f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "a8a13bff-3694-4c1e-a5ae-486d72b71662", "address": "fa:16:3e:0d:e8:58", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a13bff-36", "ovs_interfaceid": "a8a13bff-3694-4c1e-a5ae-486d72b71662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:37:36.564516 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converting VIF {"id": "a8a13bff-3694-4c1e-a5ae-486d72b71662", "address": "fa:16:3e:0d:e8:58", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a13bff-36", "ovs_interfaceid": "a8a13bff-3694-4c1e-a5ae-486d72b71662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:36.564516 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:e8:58,bridge_name='br-int',has_traffic_filtering=True,id=a8a13bff-3694-4c1e-a5ae-486d72b71662,network=Network(7f72f742-9acd-4d6e-881e-fcc3b2713b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa8a13bff-36') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:36.564516 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:e8:58,bridge_name='br-int',has_traffic_filtering=True,id=a8a13bff-3694-4c1e-a5ae-486d72b71662,network=Network(7f72f742-9acd-4d6e-881e-fcc3b2713b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa8a13bff-36') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:37:36.565048 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.565048 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.565048 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:37:36.566656 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.566656 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4f66126f-af62-508b-ae70-8944408cf92c', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.566827 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.567443 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:36.581939 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.584651 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.584838 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapa8a13bff-36, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.585195 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapa8a13bff-36, col_values=(('qos', UUID('81708dd1-421e-4cdb-8597-d4e661c8db34')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.585374 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapa8a13bff-36, col_values=(('external_ids', {'iface-id': 'a8a13bff-3694-4c1e-a5ae-486d72b71662', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0d:e8:58', 'vm-uuid': 'a686feac-bebe-47c8-a3c8-f3c2260ca7f5'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.586236 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.587405 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:36.606055 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.609821 np0000003731 nova-compute[98967]: INFO os_vif [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:e8:58,bridge_name='br-int',has_traffic_filtering=True,id=a8a13bff-3694-4c1e-a5ae-486d72b71662,network=Network(7f72f742-9acd-4d6e-881e-fcc3b2713b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa8a13bff-36') Jun 26 10:37:36.609821 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-589050877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-589050877',id=8,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOB2Sn7n/w8UeynSgIX7Pa+jWvACxe6vAPkjQBXv/eHuOpw0qYDCymYoGIWFIQ1K6gbGfZ4Mmn8WWEpLTsNoltBKnNPktYyulDt6E7QX9Q7av35lOxeQlHvrWEPuUtCAkg==',key_name='tempest-keypair-1634372885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93df6885279b4537969fc0d1beb9f198',ramdisk_id='',reservation_id='r-wpod5h0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1397657593',owner_user_name='tempest-TaggedBootDevicesTest-1397657593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a089dde66194b5b967cb79918aa1a33',uuid=a686feac-bebe-47c8-a3c8-f3c2260ca7f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "f141a8bb-5a71-4872-b62f-9fce6052875a", "address": "fa:16:3e:89:3b:98", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf141a8bb-5a", "ovs_interfaceid": "f141a8bb-5a71-4872-b62f-9fce6052875a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:37:36.609821 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converting VIF {"id": "f141a8bb-5a71-4872-b62f-9fce6052875a", "address": "fa:16:3e:89:3b:98", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf141a8bb-5a", "ovs_interfaceid": "f141a8bb-5a71-4872-b62f-9fce6052875a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:36.609821 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:3b:98,bridge_name='br-int',has_traffic_filtering=True,id=f141a8bb-5a71-4872-b62f-9fce6052875a,network=Network(7f72f742-9acd-4d6e-881e-fcc3b2713b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf141a8bb-5a') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:36.609821 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:3b:98,bridge_name='br-int',has_traffic_filtering=True,id=f141a8bb-5a71-4872-b62f-9fce6052875a,network=Network(7f72f742-9acd-4d6e-881e-fcc3b2713b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf141a8bb-5a') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:37:36.610642 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.610642 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.610642 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:37:36.612096 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.612226 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4ff4fa9c-fd1a-56fb-ac1f-d23fb70cf316', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.612935 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.613718 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:36.633195 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.635497 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.635669 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapf141a8bb-5a, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.636031 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapf141a8bb-5a, col_values=(('qos', UUID('25183a4a-e640-4b43-be3d-42b71e033d67')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.636213 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapf141a8bb-5a, col_values=(('external_ids', {'iface-id': 'f141a8bb-5a71-4872-b62f-9fce6052875a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:89:3b:98', 'vm-uuid': 'a686feac-bebe-47c8-a3c8-f3c2260ca7f5'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.639104 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.640649 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:36.668073 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.670601 np0000003731 nova-compute[98967]: INFO os_vif [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:3b:98,bridge_name='br-int',has_traffic_filtering=True,id=f141a8bb-5a71-4872-b62f-9fce6052875a,network=Network(7f72f742-9acd-4d6e-881e-fcc3b2713b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf141a8bb-5a') Jun 26 10:37:36.670601 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-589050877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-589050877',id=8,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOB2Sn7n/w8UeynSgIX7Pa+jWvACxe6vAPkjQBXv/eHuOpw0qYDCymYoGIWFIQ1K6gbGfZ4Mmn8WWEpLTsNoltBKnNPktYyulDt6E7QX9Q7av35lOxeQlHvrWEPuUtCAkg==',key_name='tempest-keypair-1634372885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93df6885279b4537969fc0d1beb9f198',ramdisk_id='',reservation_id='r-wpod5h0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1397657593',owner_user_name='tempest-TaggedBootDevicesTest-1397657593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a089dde66194b5b967cb79918aa1a33',uuid=a686feac-bebe-47c8-a3c8-f3c2260ca7f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fa54a649-79c1-4413-91b2-680216f8b045", "address": "fa:16:3e:4e:45:ca", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa54a649-79", "ovs_interfaceid": "fa54a649-79c1-4413-91b2-680216f8b045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:37:36.670601 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converting VIF {"id": "fa54a649-79c1-4413-91b2-680216f8b045", "address": "fa:16:3e:4e:45:ca", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa54a649-79", "ovs_interfaceid": "fa54a649-79c1-4413-91b2-680216f8b045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:36.670601 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:45:ca,bridge_name='br-int',has_traffic_filtering=True,id=fa54a649-79c1-4413-91b2-680216f8b045,network=Network(7f72f742-9acd-4d6e-881e-fcc3b2713b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa54a649-79') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:36.670601 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:45:ca,bridge_name='br-int',has_traffic_filtering=True,id=fa54a649-79c1-4413-91b2-680216f8b045,network=Network(7f72f742-9acd-4d6e-881e-fcc3b2713b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa54a649-79') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:37:36.671072 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.671072 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.671129 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:37:36.673735 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.673735 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8ba7a282-f6d2-51fb-ae62-d004c17a21fe', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.674521 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.675326 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:36.704861 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.707573 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.707783 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfa54a649-79, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.708150 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfa54a649-79, col_values=(('qos', UUID('91b5c4a9-4dae-425b-8036-7c4a29a45f46')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.708365 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfa54a649-79, col_values=(('external_ids', {'iface-id': 'fa54a649-79c1-4413-91b2-680216f8b045', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4e:45:ca', 'vm-uuid': 'a686feac-bebe-47c8-a3c8-f3c2260ca7f5'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.709344 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.710801 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:36.742912 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.743904 np0000003731 nova-compute[98967]: INFO os_vif [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:45:ca,bridge_name='br-int',has_traffic_filtering=True,id=fa54a649-79c1-4413-91b2-680216f8b045,network=Network(7f72f742-9acd-4d6e-881e-fcc3b2713b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa54a649-79') Jun 26 10:37:36.744800 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-589050877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-589050877',id=8,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOB2Sn7n/w8UeynSgIX7Pa+jWvACxe6vAPkjQBXv/eHuOpw0qYDCymYoGIWFIQ1K6gbGfZ4Mmn8WWEpLTsNoltBKnNPktYyulDt6E7QX9Q7av35lOxeQlHvrWEPuUtCAkg==',key_name='tempest-keypair-1634372885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93df6885279b4537969fc0d1beb9f198',ramdisk_id='',reservation_id='r-wpod5h0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1397657593',owner_user_name='tempest-TaggedBootDevicesTest-1397657593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a089dde66194b5b967cb79918aa1a33',uuid=a686feac-bebe-47c8-a3c8-f3c2260ca7f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a", "address": "fa:16:3e:fc:62:66", "network": {"id": "35589be9-ff77-40f5-8d6f-20e36bb2cd03", "bridge": "br-int", "label": "tempest-device-tagging-net2-1172567199", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0f4a94-bf", "ovs_interfaceid": "4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:37:36.745067 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converting VIF {"id": "4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a", "address": "fa:16:3e:fc:62:66", "network": {"id": "35589be9-ff77-40f5-8d6f-20e36bb2cd03", "bridge": "br-int", "label": "tempest-device-tagging-net2-1172567199", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0f4a94-bf", "ovs_interfaceid": "4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:36.745664 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:62:66,bridge_name='br-int',has_traffic_filtering=True,id=4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a,network=Network(35589be9-ff77-40f5-8d6f-20e36bb2cd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d0f4a94-bf') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:36.745945 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:62:66,bridge_name='br-int',has_traffic_filtering=True,id=4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a,network=Network(35589be9-ff77-40f5-8d6f-20e36bb2cd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d0f4a94-bf') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:37:36.746172 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.746350 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.746535 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:37:36.747532 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.747689 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e347445b-1cf6-56e9-be07-62c12cda11e9', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.748416 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.749101 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:36.778487 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.780539 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.780723 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap4d0f4a94-bf, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.781135 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap4d0f4a94-bf, col_values=(('qos', UUID('7ac01dee-57de-4be0-a5cd-cee8505624f4')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.781281 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap4d0f4a94-bf, col_values=(('external_ids', {'iface-id': '4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fc:62:66', 'vm-uuid': 'a686feac-bebe-47c8-a3c8-f3c2260ca7f5'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.782093 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.783682 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:36.815857 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.816874 np0000003731 nova-compute[98967]: INFO os_vif [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:62:66,bridge_name='br-int',has_traffic_filtering=True,id=4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a,network=Network(35589be9-ff77-40f5-8d6f-20e36bb2cd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d0f4a94-bf') Jun 26 10:37:36.817597 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-589050877',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-589050877',id=8,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOB2Sn7n/w8UeynSgIX7Pa+jWvACxe6vAPkjQBXv/eHuOpw0qYDCymYoGIWFIQ1K6gbGfZ4Mmn8WWEpLTsNoltBKnNPktYyulDt6E7QX9Q7av35lOxeQlHvrWEPuUtCAkg==',key_name='tempest-keypair-1634372885',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='93df6885279b4537969fc0d1beb9f198',ramdisk_id='',reservation_id='r-wpod5h0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest-1397657593',owner_user_name='tempest-TaggedBootDevicesTest-1397657593-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:10Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a089dde66194b5b967cb79918aa1a33',uuid=a686feac-bebe-47c8-a3c8-f3c2260ca7f5,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "53ab7bb3-88bd-4061-9d43-b6392e20c003", "address": "fa:16:3e:50:56:3a", "network": {"id": "35589be9-ff77-40f5-8d6f-20e36bb2cd03", "bridge": "br-int", "label": "tempest-device-tagging-net2-1172567199", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ab7bb3-88", "ovs_interfaceid": "53ab7bb3-88bd-4061-9d43-b6392e20c003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:37:36.817778 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converting VIF {"id": "53ab7bb3-88bd-4061-9d43-b6392e20c003", "address": "fa:16:3e:50:56:3a", "network": {"id": "35589be9-ff77-40f5-8d6f-20e36bb2cd03", "bridge": "br-int", "label": "tempest-device-tagging-net2-1172567199", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ab7bb3-88", "ovs_interfaceid": "53ab7bb3-88bd-4061-9d43-b6392e20c003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:36.818244 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:56:3a,bridge_name='br-int',has_traffic_filtering=True,id=53ab7bb3-88bd-4061-9d43-b6392e20c003,network=Network(35589be9-ff77-40f5-8d6f-20e36bb2cd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ab7bb3-88') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:36.818503 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:56:3a,bridge_name='br-int',has_traffic_filtering=True,id=53ab7bb3-88bd-4061-9d43-b6392e20c003,network=Network(35589be9-ff77-40f5-8d6f-20e36bb2cd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ab7bb3-88') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:37:36.818775 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.819020 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.819223 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:37:36.820173 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.820378 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '2b49c2ee-f971-5f56-adfe-7c4d7c9410c1', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.821137 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.821763 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:36.840199 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "047061b2-340c-4cc9-899b-0744dad0081f" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:36.840673 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "047061b2-340c-4cc9-899b-0744dad0081f" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:36.859755 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.868325 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Allocating IP information in the background. {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 26 10:37:36.868949 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] allocate_for_instance() {{(pid=98967) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 26 10:37:36.869591 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:36.869895 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:36.871539 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.872704 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap53ab7bb3-88, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.873138 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap53ab7bb3-88, col_values=(('qos', UUID('50c7368c-90ac-4302-bef2-96d900594946')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.873323 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap53ab7bb3-88, col_values=(('external_ids', {'iface-id': '53ab7bb3-88bd-4061-9d43-b6392e20c003', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:50:56:3a', 'vm-uuid': 'a686feac-bebe-47c8-a3c8-f3c2260ca7f5'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:36.874244 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.875636 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:36.913586 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:36.914654 np0000003731 nova-compute[98967]: INFO os_vif [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:56:3a,bridge_name='br-int',has_traffic_filtering=True,id=53ab7bb3-88bd-4061-9d43-b6392e20c003,network=Network(35589be9-ff77-40f5-8d6f-20e36bb2cd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ab7bb3-88') Jun 26 10:37:36.975697 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:36.980823 np0000003731 nova-compute[98967]: DEBUG nova.policy [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8a8a0b0240a34fb0bcf62ee7ec259cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2798faed447838b6c87f6d15cce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98967) authorize /opt/stack/nova/nova/policy.py:192}} Jun 26 10:37:37.226861 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Creating config drive at /opt/stack/data/nova/instances/78222936-8bdc-4928-a30e-924af89fd8b9/disk.config Jun 26 10:37:37.226861 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/78222936-8bdc-4928-a30e-924af89fd8b9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmph6yuxz39 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:37.289951 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/78222936-8bdc-4928-a30e-924af89fd8b9/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmph6yuxz39" returned: 0 in 0.071s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:37.342924 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Starting instance... {{(pid=98967) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 26 10:37:37.369468 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 26 10:37:37.373943 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:37.621209 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Successfully created port: 32e8fd61-b6bb-41bf-80b8-c09e23741e03 {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:37:37.790588 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "25b12be8-e92b-4705-b668-05cfecaf66b3" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:37.790813 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "25b12be8-e92b-4705-b668-05cfecaf66b3" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:37.826877 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:37.878697 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Start building block device mappings for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 26 10:37:37.887854 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:37.913165 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:37.913165 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:37.923307 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98967) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 26 10:37:37.923430 np0000003731 nova-compute[98967]: INFO nova.compute.claims [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Claim successful on node np0000003731 Jun 26 10:37:37.951736 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:38.178162 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-4d41f855-a795-479a-91b1-b3b2cdd2baa0 req-88b5e62c-a331-44b0-a75f-88766422a388 service nova] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Received event network-vif-plugged-c82a5e66-4de5-45f5-aa1f-23cf9fb96c74 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:38.178586 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-4d41f855-a795-479a-91b1-b3b2cdd2baa0 req-88b5e62c-a331-44b0-a75f-88766422a388 service nova] Acquiring lock "78222936-8bdc-4928-a30e-924af89fd8b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:38.179317 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-4d41f855-a795-479a-91b1-b3b2cdd2baa0 req-88b5e62c-a331-44b0-a75f-88766422a388 service nova] Lock "78222936-8bdc-4928-a30e-924af89fd8b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:38.179317 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-4d41f855-a795-479a-91b1-b3b2cdd2baa0 req-88b5e62c-a331-44b0-a75f-88766422a388 service nova] Lock "78222936-8bdc-4928-a30e-924af89fd8b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:38.179317 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-4d41f855-a795-479a-91b1-b3b2cdd2baa0 req-88b5e62c-a331-44b0-a75f-88766422a388 service nova] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Processing event network-vif-plugged-c82a5e66-4de5-45f5-aa1f-23cf9fb96c74 {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:37:38.191581 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:38.229357 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:38.235821 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:38.286420 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:38.294217 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Starting instance... {{(pid=98967) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 26 10:37:38.327419 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:38.411036 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Successfully updated port: 32e8fd61-b6bb-41bf-80b8-c09e23741e03 {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:37:38.461526 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:38.461526 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:38.461526 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] No VIF found with MAC fa:16:3e:98:a5:6d, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:37:38.461526 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] No VIF found with MAC fa:16:3e:4e:45:ca, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:37:38.462367 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Using config drive Jun 26 10:37:38.812644 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:38.812845 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] VM Started (Lifecycle Event) Jun 26 10:37:38.813970 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:37:38.817307 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Guest created on hypervisor {{(pid=98967) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 26 10:37:38.819186 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Instance spawned successfully. Jun 26 10:37:38.820507 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 26 10:37:38.853476 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:38.892186 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Start spawning the instance on the hypervisor. {{(pid=98967) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 26 10:37:38.893650 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Creating instance directory {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 26 10:37:38.900117 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Creating image(s) Jun 26 10:37:38.900823 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "/opt/stack/data/nova/instances/212147b0-26de-42cd-b43d-057ec8d61c72/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:38.900823 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "/opt/stack/data/nova/instances/212147b0-26de-42cd-b43d-057ec8d61c72/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:38.901875 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "/opt/stack/data/nova/instances/212147b0-26de-42cd-b43d-057ec8d61c72/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:38.902390 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:38.909258 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:38.910077 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:38.922953 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "refresh_cache-212147b0-26de-42cd-b43d-057ec8d61c72" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:38.922953 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquired lock "refresh_cache-212147b0-26de-42cd-b43d-057ec8d61c72" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:38.922953 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:37:38.985821 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:38.992343 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.079s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:38.992343 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:38.992343 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:38.992343 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:38.994589 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:38.994589 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:39.081053 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.086s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:39.092788 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/212147b0-26de-42cd-b43d-057ec8d61c72/disk 1073741824 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:39.164384 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/212147b0-26de-42cd-b43d-057ec8d61c72/disk 1073741824" returned: 0 in 0.071s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:39.164953 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.176s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:39.165336 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:39.227372 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Creating config drive at /opt/stack/data/nova/instances/a686feac-bebe-47c8-a3c8-f3c2260ca7f5/disk.config Jun 26 10:37:39.241359 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/a686feac-bebe-47c8-a3c8-f3c2260ca7f5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpoxr4rt2z {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:39.251991 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.085s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:39.253492 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Checking if we can resize image /opt/stack/data/nova/instances/212147b0-26de-42cd-b43d-057ec8d61c72/disk. size=1073741824 {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 26 10:37:39.254384 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212147b0-26de-42cd-b43d-057ec8d61c72/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:39.289303 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/a686feac-bebe-47c8-a3c8-f3c2260ca7f5/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpoxr4rt2z" returned: 0 in 0.048s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:39.317516 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:39.320770 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:37:39.331781 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Found default for hw_cdrom_bus of ide {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:39.331781 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Found default for hw_disk_bus of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:39.331781 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Found default for hw_input_bus of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:39.331781 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Found default for hw_pointer_model of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:39.331781 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Found default for hw_video_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:39.331781 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Found default for hw_vif_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:39.332707 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212147b0-26de-42cd-b43d-057ec8d61c72/disk --force-share --output=json" returned: 0 in 0.078s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:39.333731 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Cannot resize image /opt/stack/data/nova/instances/212147b0-26de-42cd-b43d-057ec8d61c72/disk to a smaller size. {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 26 10:37:39.334119 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Created local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 26 10:37:39.334335 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Ensure instance console log exists: /opt/stack/data/nova/instances/212147b0-26de-42cd-b43d-057ec8d61c72/console.log {{(pid=98967) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 26 10:37:39.334659 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:39.334898 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:39.335086 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:39.512057 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:37:39.739432 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:39.762623 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:39.817183 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:39.818222 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:39.826444 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] During sync_power_state the instance has a pending task (spawning). Skip. Jun 26 10:37:39.826752 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Paused> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:39.826752 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] VM Paused (Lifecycle Event) Jun 26 10:37:39.834300 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Took 7.89 seconds to spawn the instance on the hypervisor. Jun 26 10:37:39.834432 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:39.882057 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:37:39.882057 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:37:39.886311 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:39.917054 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:39.972886 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Updating instance_info_cache with network_info: [{"id": "32e8fd61-b6bb-41bf-80b8-c09e23741e03", "address": "fa:16:3e:90:be:9c", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e8fd61-b6", "ovs_interfaceid": "32e8fd61-b6bb-41bf-80b8-c09e23741e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:40.002582 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:40.031397 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:40.066019 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:40.077077 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:40.092163 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:40.094434 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-d9054cf6-e485-46b5-90b8-62c29f562812 req-e9e7be92-9b55-4f52-a712-d24177014540 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-plugged-38973918-1218-4531-8941-0e9fbff30e3e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:40.094672 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-d9054cf6-e485-46b5-90b8-62c29f562812 req-e9e7be92-9b55-4f52-a712-d24177014540 service nova] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:40.095043 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-d9054cf6-e485-46b5-90b8-62c29f562812 req-e9e7be92-9b55-4f52-a712-d24177014540 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:40.096729 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-d9054cf6-e485-46b5-90b8-62c29f562812 req-e9e7be92-9b55-4f52-a712-d24177014540 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:40.096729 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-d9054cf6-e485-46b5-90b8-62c29f562812 req-e9e7be92-9b55-4f52-a712-d24177014540 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Processing event network-vif-plugged-38973918-1218-4531-8941-0e9fbff30e3e {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:37:40.096729 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:40.122252 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:40.145959 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:40.191538 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:40.203274 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:40.247153 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:40.267711 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-5926256a-308d-45f4-9e03-5eaf1d43f6a9 req-be91a4c1-6c47-4efb-aeb6-0580b74e9c29 service nova] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Received event network-changed-32e8fd61-b6bb-41bf-80b8-c09e23741e03 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:40.267784 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-5926256a-308d-45f4-9e03-5eaf1d43f6a9 req-be91a4c1-6c47-4efb-aeb6-0580b74e9c29 service nova] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Refreshing instance network info cache due to event network-changed-32e8fd61-b6bb-41bf-80b8-c09e23741e03. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:37:40.271124 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5926256a-308d-45f4-9e03-5eaf1d43f6a9 req-be91a4c1-6c47-4efb-aeb6-0580b74e9c29 service nova] Acquiring lock "refresh_cache-212147b0-26de-42cd-b43d-057ec8d61c72" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:40.271901 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:40.292805 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:40.328598 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:40.330663 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:40.337541 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:40.337541 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] VM Resumed (Lifecycle Event) Jun 26 10:37:40.344442 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-c8a8111f-5075-41f0-9556-24cad1343a47 req-39a848de-04bd-411d-8913-105587217714 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-plugged-a8a13bff-3694-4c1e-a5ae-486d72b71662 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:40.345027 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c8a8111f-5075-41f0-9556-24cad1343a47 req-39a848de-04bd-411d-8913-105587217714 service nova] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:40.345027 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c8a8111f-5075-41f0-9556-24cad1343a47 req-39a848de-04bd-411d-8913-105587217714 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:40.345027 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c8a8111f-5075-41f0-9556-24cad1343a47 req-39a848de-04bd-411d-8913-105587217714 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:40.345027 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-c8a8111f-5075-41f0-9556-24cad1343a47 req-39a848de-04bd-411d-8913-105587217714 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Processing event network-vif-plugged-a8a13bff-3694-4c1e-a5ae-486d72b71662 {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:37:40.355590 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Took 13.61 seconds to build instance. Jun 26 10:37:40.423352 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:37:40.434981 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:40.452168 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:40.487547 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Releasing lock "refresh_cache-212147b0-26de-42cd-b43d-057ec8d61c72" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:40.487547 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Instance network_info: |[{"id": "32e8fd61-b6bb-41bf-80b8-c09e23741e03", "address": "fa:16:3e:90:be:9c", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e8fd61-b6", "ovs_interfaceid": "32e8fd61-b6bb-41bf-80b8-c09e23741e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 26 10:37:40.487547 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Start _get_guest_xml network_info=[{"id": "32e8fd61-b6bb-41bf-80b8-c09e23741e03", "address": "fa:16:3e:90:be:9c", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e8fd61-b6", "ovs_interfaceid": "32e8fd61-b6bb-41bf-80b8-c09e23741e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'image_id': 'a9b18127-6fee-4ed6-b364-a2d634ecb8b7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:37:40.487547 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5926256a-308d-45f4-9e03-5eaf1d43f6a9 req-be91a4c1-6c47-4efb-aeb6-0580b74e9c29 service nova] Acquired lock "refresh_cache-212147b0-26de-42cd-b43d-057ec8d61c72" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:40.487547 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-5926256a-308d-45f4-9e03-5eaf1d43f6a9 req-be91a4c1-6c47-4efb-aeb6-0580b74e9c29 service nova] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Refreshing network info cache for port 32e8fd61-b6bb-41bf-80b8-c09e23741e03 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:37:40.487547 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-58573357-1f70-4083-a92c-950b89706067 req-c35a8d6f-a352-477a-b749-f2375356c9b2 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-plugged-f141a8bb-5a71-4872-b62f-9fce6052875a {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:40.487547 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-58573357-1f70-4083-a92c-950b89706067 req-c35a8d6f-a352-477a-b749-f2375356c9b2 service nova] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:40.487547 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-58573357-1f70-4083-a92c-950b89706067 req-c35a8d6f-a352-477a-b749-f2375356c9b2 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:40.487547 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-58573357-1f70-4083-a92c-950b89706067 req-c35a8d6f-a352-477a-b749-f2375356c9b2 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:40.487547 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-58573357-1f70-4083-a92c-950b89706067 req-c35a8d6f-a352-477a-b749-f2375356c9b2 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Processing event network-vif-plugged-f141a8bb-5a71-4872-b62f-9fce6052875a {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:37:40.488543 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:37:40.508482 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='212147b0-26de-42cd-b43d-057ec8d61c72'), owner=OwnerMeta(userid='8a8a0b0240a34fb0bcf62ee7ec259cb2', username='tempest-AttachVolumeMultiAttachTest-1668992443-project-member', projectid='49c2798faed447838b6c87f6d15cce66', projectname='tempest-AttachVolumeMultiAttachTest-1668992443'), image=ImageMeta(id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "32e8fd61-b6bb-41bf-80b8-c09e23741e03", "address": "fa:16:3e:90:be:9c", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e8fd61-b6", "ovs_interfaceid": "32e8fd61-b6bb-41bf-80b8-c09e23741e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470260.4895513) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:37:40.510997 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:37:40.511724 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:37:40.512344 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:37:40.512753 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:37:40.521866 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:37:40.521866 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:37:40.521866 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:37:40.521866 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:37:40.521866 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:37:40.521866 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:37:40.521866 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:37:40.521866 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:37:40.521866 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:37:40.521866 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:37:40.521866 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:37:40.521866 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:37:40.528942 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:40.567354 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:37:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='multiattach-server-1',id=11,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIANZiDTtI5cmApVvRJAaLuw+rm1nR4eCOZjHwVoNWhAR53DFExlyLfMWz+jjXnkCXdfpUcLxD2eMk9e+d1HV7SCzQccChfvPKV4jw2Mlc92UdPlKs2IxpAJWXP9L/ysw==',key_name='tempest-keypair-1990365436',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49c2798faed447838b6c87f6d15cce66',ramdisk_id='',reservation_id='r-49e0cogl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1668992443',owner_user_name='tempest-AttachVolumeMultiAttachTest-1668992443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a8a0b0240a34fb0bcf62ee7ec259cb2',uuid=212147b0-26de-42cd-b43d-057ec8d61c72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32e8fd61-b6bb-41bf-80b8-c09e23741e03", "address": "fa:16:3e:90:be:9c", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e8fd61-b6", "ovs_interfaceid": "32e8fd61-b6bb-41bf-80b8-c09e23741e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:37:40.577952 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Converting VIF {"id": "32e8fd61-b6bb-41bf-80b8-c09e23741e03", "address": "fa:16:3e:90:be:9c", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e8fd61-b6", "ovs_interfaceid": "32e8fd61-b6bb-41bf-80b8-c09e23741e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:40.577952 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:be:9c,bridge_name='br-int',has_traffic_filtering=True,id=32e8fd61-b6bb-41bf-80b8-c09e23741e03,network=Network(204eb6a3-9452-412e-ab0b-1594eb86bed2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e8fd61-b6') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:40.577952 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lazy-loading 'pci_devices' on Instance uuid 212147b0-26de-42cd-b43d-057ec8d61c72 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:37:40.604272 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:40.628866 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:40.634146 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:40.737645 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:40.844270 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:40.849336 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:37:40.860654 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d6e1d73a-f2e2-46da-b6a3-baf100149f16 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Lock "78222936-8bdc-4928-a30e-924af89fd8b9" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.137s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:40.873773 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:40.881080 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:40.882152 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:40.900382 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.987s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:40.902226 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Start building networks asynchronously for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 26 10:37:40.905943 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.053s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:40.907707 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:40.909035 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:40.912368 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98967) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 26 10:37:40.912709 np0000003731 nova-compute[98967]: INFO nova.compute.claims [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Claim successful on node np0000003731 Jun 26 10:37:40.983870 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-5926256a-308d-45f4-9e03-5eaf1d43f6a9 req-be91a4c1-6c47-4efb-aeb6-0580b74e9c29 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] End _get_guest_xml xml= Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: 212147b0-26de-42cd-b43d-057ec8d61c72 Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: instance-0000000b Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: 196608 Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: multiattach-server-1 Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: 2026-06-26 10:37:40 Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: 192 Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: True Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: bare Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: virtio Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: tempest-AttachVolumeMultiAttachTest-1668992443-project-member Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: tempest-AttachVolumeMultiAttachTest-1668992443 Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: 212147b0-26de-42cd-b43d-057ec8d61c72 Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: 212147b0-26de-42cd-b43d-057ec8d61c72 Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: hvm Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: 128 Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Preparing to wait for external event network-vif-plugged-32e8fd61-b6bb-41bf-80b8-c09e23741e03 {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "212147b0-26de-42cd-b43d-057ec8d61c72-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:41.074896 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "212147b0-26de-42cd-b43d-057ec8d61c72-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:41.087447 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "212147b0-26de-42cd-b43d-057ec8d61c72-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:41.087447 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:37:31Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='multiattach-server-1',id=11,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIANZiDTtI5cmApVvRJAaLuw+rm1nR4eCOZjHwVoNWhAR53DFExlyLfMWz+jjXnkCXdfpUcLxD2eMk9e+d1HV7SCzQccChfvPKV4jw2Mlc92UdPlKs2IxpAJWXP9L/ysw==',key_name='tempest-keypair-1990365436',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49c2798faed447838b6c87f6d15cce66',ramdisk_id='',reservation_id='r-49e0cogl',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1668992443',owner_user_name='tempest-AttachVolumeMultiAttachTest-1668992443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a8a0b0240a34fb0bcf62ee7ec259cb2',uuid=212147b0-26de-42cd-b43d-057ec8d61c72,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "32e8fd61-b6bb-41bf-80b8-c09e23741e03", "address": "fa:16:3e:90:be:9c", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e8fd61-b6", "ovs_interfaceid": "32e8fd61-b6bb-41bf-80b8-c09e23741e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:37:41.087447 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Converting VIF {"id": "32e8fd61-b6bb-41bf-80b8-c09e23741e03", "address": "fa:16:3e:90:be:9c", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e8fd61-b6", "ovs_interfaceid": "32e8fd61-b6bb-41bf-80b8-c09e23741e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:41.087447 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:90:be:9c,bridge_name='br-int',has_traffic_filtering=True,id=32e8fd61-b6bb-41bf-80b8-c09e23741e03,network=Network(204eb6a3-9452-412e-ab0b-1594eb86bed2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e8fd61-b6') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:41.087447 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:be:9c,bridge_name='br-int',has_traffic_filtering=True,id=32e8fd61-b6bb-41bf-80b8-c09e23741e03,network=Network(204eb6a3-9452-412e-ab0b-1594eb86bed2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e8fd61-b6') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:37:41.087447 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:41.087447 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:41.087447 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:37:41.096502 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:41.096775 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '79cc6bb8-5b48-51fe-820a-2f06e89629b1', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:41.099458 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:41.099458 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:41.099458 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:41.103280 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:41.103512 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap32e8fd61-b6, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:41.103895 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap32e8fd61-b6, col_values=(('qos', UUID('97a137c2-5536-46bc-b3fe-d19e7f867406')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:41.104113 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap32e8fd61-b6, col_values=(('external_ids', {'iface-id': '32e8fd61-b6bb-41bf-80b8-c09e23741e03', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:90:be:9c', 'vm-uuid': '212147b0-26de-42cd-b43d-057ec8d61c72'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:41.105987 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:41.108222 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:41.114526 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:41.116209 np0000003731 nova-compute[98967]: INFO os_vif [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:90:be:9c,bridge_name='br-int',has_traffic_filtering=True,id=32e8fd61-b6bb-41bf-80b8-c09e23741e03,network=Network(204eb6a3-9452-412e-ab0b-1594eb86bed2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap32e8fd61-b6') Jun 26 10:37:41.246150 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:41.254806 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:41.410668 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Allocating IP information in the background. {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 26 10:37:41.410668 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] allocate_for_instance() {{(pid=98967) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 26 10:37:41.410668 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:41.411293 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:41.451919 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:41.461955 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:41.547786 np0000003731 nova-compute[98967]: DEBUG nova.policy [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '04176251e13046eb8cfc1908246d4d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a58b94e5ec406182da9117e14aa789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98967) authorize /opt/stack/nova/nova/policy.py:192}} Jun 26 10:37:41.585269 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-5926256a-308d-45f4-9e03-5eaf1d43f6a9 req-be91a4c1-6c47-4efb-aeb6-0580b74e9c29 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:41.669685 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:41.681464 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:41.848032 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-5926256a-308d-45f4-9e03-5eaf1d43f6a9 req-be91a4c1-6c47-4efb-aeb6-0580b74e9c29 service nova] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Updated VIF entry in instance network info cache for port 32e8fd61-b6bb-41bf-80b8-c09e23741e03. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:37:41.849155 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-5926256a-308d-45f4-9e03-5eaf1d43f6a9 req-be91a4c1-6c47-4efb-aeb6-0580b74e9c29 service nova] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Updating instance_info_cache with network_info: [{"id": "32e8fd61-b6bb-41bf-80b8-c09e23741e03", "address": "fa:16:3e:90:be:9c", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e8fd61-b6", "ovs_interfaceid": "32e8fd61-b6bb-41bf-80b8-c09e23741e03", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:41.919449 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 26 10:37:42.118928 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:42.131742 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:42.141656 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:42.188144 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:42.227875 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:42.227875 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] VM Started (Lifecycle Event) Jun 26 10:37:42.232558 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-1d6f003c-bdff-4d5b-be3e-d839f2f8e079 req-34867aa5-8605-4339-9dbb-90fc69c40de8 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-plugged-38973918-1218-4531-8941-0e9fbff30e3e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:42.232722 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-1d6f003c-bdff-4d5b-be3e-d839f2f8e079 req-34867aa5-8605-4339-9dbb-90fc69c40de8 service nova] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:42.232902 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-1d6f003c-bdff-4d5b-be3e-d839f2f8e079 req-34867aa5-8605-4339-9dbb-90fc69c40de8 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:42.232999 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-1d6f003c-bdff-4d5b-be3e-d839f2f8e079 req-34867aa5-8605-4339-9dbb-90fc69c40de8 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:42.233175 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-1d6f003c-bdff-4d5b-be3e-d839f2f8e079 req-34867aa5-8605-4339-9dbb-90fc69c40de8 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] No event matching network-vif-plugged-38973918-1218-4531-8941-0e9fbff30e3e in dict_keys([('network-vif-plugged', '99b479ce-38b6-464c-a476-7039543e31d9'), ('network-vif-plugged', 'fa54a649-79c1-4413-91b2-680216f8b045'), ('network-vif-plugged', '4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a'), ('network-vif-plugged', '53ab7bb3-88bd-4061-9d43-b6392e20c003')]) {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 26 10:37:42.233314 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-1d6f003c-bdff-4d5b-be3e-d839f2f8e079 req-34867aa5-8605-4339-9dbb-90fc69c40de8 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received unexpected event network-vif-plugged-38973918-1218-4531-8941-0e9fbff30e3e for instance with vm_state building and task_state spawning. Jun 26 10:37:42.234436 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-1d6f003c-bdff-4d5b-be3e-d839f2f8e079 req-34867aa5-8605-4339-9dbb-90fc69c40de8 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-plugged-fa54a649-79c1-4413-91b2-680216f8b045 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:42.234581 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-1d6f003c-bdff-4d5b-be3e-d839f2f8e079 req-34867aa5-8605-4339-9dbb-90fc69c40de8 service nova] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:42.234875 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-1d6f003c-bdff-4d5b-be3e-d839f2f8e079 req-34867aa5-8605-4339-9dbb-90fc69c40de8 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:42.234875 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-1d6f003c-bdff-4d5b-be3e-d839f2f8e079 req-34867aa5-8605-4339-9dbb-90fc69c40de8 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:42.235058 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-1d6f003c-bdff-4d5b-be3e-d839f2f8e079 req-34867aa5-8605-4339-9dbb-90fc69c40de8 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Processing event network-vif-plugged-fa54a649-79c1-4413-91b2-680216f8b045 {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:37:42.235606 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-1d6f003c-bdff-4d5b-be3e-d839f2f8e079 req-34867aa5-8605-4339-9dbb-90fc69c40de8 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-plugged-fa54a649-79c1-4413-91b2-680216f8b045 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:42.235738 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-1d6f003c-bdff-4d5b-be3e-d839f2f8e079 req-34867aa5-8605-4339-9dbb-90fc69c40de8 service nova] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:42.235891 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-1d6f003c-bdff-4d5b-be3e-d839f2f8e079 req-34867aa5-8605-4339-9dbb-90fc69c40de8 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:42.235970 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-1d6f003c-bdff-4d5b-be3e-d839f2f8e079 req-34867aa5-8605-4339-9dbb-90fc69c40de8 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:42.236114 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-1d6f003c-bdff-4d5b-be3e-d839f2f8e079 req-34867aa5-8605-4339-9dbb-90fc69c40de8 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] No event matching network-vif-plugged-fa54a649-79c1-4413-91b2-680216f8b045 in dict_keys([('network-vif-plugged', '99b479ce-38b6-464c-a476-7039543e31d9'), ('network-vif-plugged', '4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a'), ('network-vif-plugged', '53ab7bb3-88bd-4061-9d43-b6392e20c003')]) {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 26 10:37:42.236244 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-1d6f003c-bdff-4d5b-be3e-d839f2f8e079 req-34867aa5-8605-4339-9dbb-90fc69c40de8 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received unexpected event network-vif-plugged-fa54a649-79c1-4413-91b2-680216f8b045 for instance with vm_state building and task_state spawning. Jun 26 10:37:42.236343 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-1d6f003c-bdff-4d5b-be3e-d839f2f8e079 req-34867aa5-8605-4339-9dbb-90fc69c40de8 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-plugged-4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:42.236694 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-1d6f003c-bdff-4d5b-be3e-d839f2f8e079 req-34867aa5-8605-4339-9dbb-90fc69c40de8 service nova] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:42.236919 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-1d6f003c-bdff-4d5b-be3e-d839f2f8e079 req-34867aa5-8605-4339-9dbb-90fc69c40de8 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:42.237327 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-1d6f003c-bdff-4d5b-be3e-d839f2f8e079 req-34867aa5-8605-4339-9dbb-90fc69c40de8 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:42.237380 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-1d6f003c-bdff-4d5b-be3e-d839f2f8e079 req-34867aa5-8605-4339-9dbb-90fc69c40de8 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Processing event network-vif-plugged-4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:37:42.237507 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-1d6f003c-bdff-4d5b-be3e-d839f2f8e079 req-34867aa5-8605-4339-9dbb-90fc69c40de8 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-plugged-4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:42.237616 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-1d6f003c-bdff-4d5b-be3e-d839f2f8e079 req-34867aa5-8605-4339-9dbb-90fc69c40de8 service nova] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:42.237714 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-1d6f003c-bdff-4d5b-be3e-d839f2f8e079 req-34867aa5-8605-4339-9dbb-90fc69c40de8 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:42.237812 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-1d6f003c-bdff-4d5b-be3e-d839f2f8e079 req-34867aa5-8605-4339-9dbb-90fc69c40de8 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:42.237911 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-1d6f003c-bdff-4d5b-be3e-d839f2f8e079 req-34867aa5-8605-4339-9dbb-90fc69c40de8 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] No event matching network-vif-plugged-4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a in dict_keys([('network-vif-plugged', '99b479ce-38b6-464c-a476-7039543e31d9'), ('network-vif-plugged', '53ab7bb3-88bd-4061-9d43-b6392e20c003')]) {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 26 10:37:42.238035 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-1d6f003c-bdff-4d5b-be3e-d839f2f8e079 req-34867aa5-8605-4339-9dbb-90fc69c40de8 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received unexpected event network-vif-plugged-4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a for instance with vm_state building and task_state spawning. Jun 26 10:37:42.349855 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "81a0f65d-2017-4275-aabe-88bc8c81225d" by "nova.compute.manager.ComputeManager.shelve_instance..do_shelve_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:42.350383 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d" acquired by "nova.compute.manager.ComputeManager.shelve_instance..do_shelve_instance" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:42.350383 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Shelving Jun 26 10:37:42.354723 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5926256a-308d-45f4-9e03-5eaf1d43f6a9 req-be91a4c1-6c47-4efb-aeb6-0580b74e9c29 service nova] Releasing lock "refresh_cache-212147b0-26de-42cd-b43d-057ec8d61c72" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:42.354927 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-5926256a-308d-45f4-9e03-5eaf1d43f6a9 req-be91a4c1-6c47-4efb-aeb6-0580b74e9c29 service nova] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Received event network-vif-plugged-c82a5e66-4de5-45f5-aa1f-23cf9fb96c74 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:42.355178 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5926256a-308d-45f4-9e03-5eaf1d43f6a9 req-be91a4c1-6c47-4efb-aeb6-0580b74e9c29 service nova] Acquiring lock "78222936-8bdc-4928-a30e-924af89fd8b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:42.355327 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5926256a-308d-45f4-9e03-5eaf1d43f6a9 req-be91a4c1-6c47-4efb-aeb6-0580b74e9c29 service nova] Lock "78222936-8bdc-4928-a30e-924af89fd8b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:42.355462 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5926256a-308d-45f4-9e03-5eaf1d43f6a9 req-be91a4c1-6c47-4efb-aeb6-0580b74e9c29 service nova] Lock "78222936-8bdc-4928-a30e-924af89fd8b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:42.355609 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-5926256a-308d-45f4-9e03-5eaf1d43f6a9 req-be91a4c1-6c47-4efb-aeb6-0580b74e9c29 service nova] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] No waiting events found dispatching network-vif-plugged-c82a5e66-4de5-45f5-aa1f-23cf9fb96c74 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:37:42.355736 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-5926256a-308d-45f4-9e03-5eaf1d43f6a9 req-be91a4c1-6c47-4efb-aeb6-0580b74e9c29 service nova] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Received unexpected event network-vif-plugged-c82a5e66-4de5-45f5-aa1f-23cf9fb96c74 for instance with vm_state active and task_state None. Jun 26 10:37:42.374912 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-fe060125-7c00-4246-95b2-691c92c4dd8b req-9fba2565-392b-457c-8e6c-9886515f5817 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-plugged-99b479ce-38b6-464c-a476-7039543e31d9 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:42.374912 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-fe060125-7c00-4246-95b2-691c92c4dd8b req-9fba2565-392b-457c-8e6c-9886515f5817 service nova] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:42.374912 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-fe060125-7c00-4246-95b2-691c92c4dd8b req-9fba2565-392b-457c-8e6c-9886515f5817 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:42.374912 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-fe060125-7c00-4246-95b2-691c92c4dd8b req-9fba2565-392b-457c-8e6c-9886515f5817 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:42.374912 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-fe060125-7c00-4246-95b2-691c92c4dd8b req-9fba2565-392b-457c-8e6c-9886515f5817 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Processing event network-vif-plugged-99b479ce-38b6-464c-a476-7039543e31d9 {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:37:42.374912 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-fe060125-7c00-4246-95b2-691c92c4dd8b req-9fba2565-392b-457c-8e6c-9886515f5817 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-plugged-99b479ce-38b6-464c-a476-7039543e31d9 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:42.374912 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-fe060125-7c00-4246-95b2-691c92c4dd8b req-9fba2565-392b-457c-8e6c-9886515f5817 service nova] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:42.374912 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-fe060125-7c00-4246-95b2-691c92c4dd8b req-9fba2565-392b-457c-8e6c-9886515f5817 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:42.374912 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-fe060125-7c00-4246-95b2-691c92c4dd8b req-9fba2565-392b-457c-8e6c-9886515f5817 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:42.374912 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-fe060125-7c00-4246-95b2-691c92c4dd8b req-9fba2565-392b-457c-8e6c-9886515f5817 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] No event matching network-vif-plugged-99b479ce-38b6-464c-a476-7039543e31d9 in dict_keys([('network-vif-plugged', '53ab7bb3-88bd-4061-9d43-b6392e20c003')]) {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 26 10:37:42.374912 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-fe060125-7c00-4246-95b2-691c92c4dd8b req-9fba2565-392b-457c-8e6c-9886515f5817 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received unexpected event network-vif-plugged-99b479ce-38b6-464c-a476-7039543e31d9 for instance with vm_state building and task_state spawning. Jun 26 10:37:42.377078 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:42.423209 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Start building block device mappings for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 26 10:37:42.459717 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-02e73dc8-ec20-4b31-af17-18a8f1a16a8c req-d4b0af27-d0b9-443c-a681-03a85ccb9e6c service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-plugged-a8a13bff-3694-4c1e-a5ae-486d72b71662 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:42.459717 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-02e73dc8-ec20-4b31-af17-18a8f1a16a8c req-d4b0af27-d0b9-443c-a681-03a85ccb9e6c service nova] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:42.459717 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-02e73dc8-ec20-4b31-af17-18a8f1a16a8c req-d4b0af27-d0b9-443c-a681-03a85ccb9e6c service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:42.459717 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-02e73dc8-ec20-4b31-af17-18a8f1a16a8c req-d4b0af27-d0b9-443c-a681-03a85ccb9e6c service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:42.459717 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-02e73dc8-ec20-4b31-af17-18a8f1a16a8c req-d4b0af27-d0b9-443c-a681-03a85ccb9e6c service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] No event matching network-vif-plugged-a8a13bff-3694-4c1e-a5ae-486d72b71662 in dict_keys([('network-vif-plugged', '53ab7bb3-88bd-4061-9d43-b6392e20c003')]) {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 26 10:37:42.459717 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-02e73dc8-ec20-4b31-af17-18a8f1a16a8c req-d4b0af27-d0b9-443c-a681-03a85ccb9e6c service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received unexpected event network-vif-plugged-a8a13bff-3694-4c1e-a5ae-486d72b71662 for instance with vm_state building and task_state spawning. Jun 26 10:37:42.459717 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-02e73dc8-ec20-4b31-af17-18a8f1a16a8c req-d4b0af27-d0b9-443c-a681-03a85ccb9e6c service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-plugged-53ab7bb3-88bd-4061-9d43-b6392e20c003 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:42.459717 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-02e73dc8-ec20-4b31-af17-18a8f1a16a8c req-d4b0af27-d0b9-443c-a681-03a85ccb9e6c service nova] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:42.459717 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-02e73dc8-ec20-4b31-af17-18a8f1a16a8c req-d4b0af27-d0b9-443c-a681-03a85ccb9e6c service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:42.459717 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-02e73dc8-ec20-4b31-af17-18a8f1a16a8c req-d4b0af27-d0b9-443c-a681-03a85ccb9e6c service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:42.459717 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-02e73dc8-ec20-4b31-af17-18a8f1a16a8c req-d4b0af27-d0b9-443c-a681-03a85ccb9e6c service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Processing event network-vif-plugged-53ab7bb3-88bd-4061-9d43-b6392e20c003 {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:37:42.459717 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-02e73dc8-ec20-4b31-af17-18a8f1a16a8c req-d4b0af27-d0b9-443c-a681-03a85ccb9e6c service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-plugged-53ab7bb3-88bd-4061-9d43-b6392e20c003 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:42.459717 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-02e73dc8-ec20-4b31-af17-18a8f1a16a8c req-d4b0af27-d0b9-443c-a681-03a85ccb9e6c service nova] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:42.461152 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-02e73dc8-ec20-4b31-af17-18a8f1a16a8c req-d4b0af27-d0b9-443c-a681-03a85ccb9e6c service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:42.461152 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-02e73dc8-ec20-4b31-af17-18a8f1a16a8c req-d4b0af27-d0b9-443c-a681-03a85ccb9e6c service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:42.461152 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-02e73dc8-ec20-4b31-af17-18a8f1a16a8c req-d4b0af27-d0b9-443c-a681-03a85ccb9e6c service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] No waiting events found dispatching network-vif-plugged-53ab7bb3-88bd-4061-9d43-b6392e20c003 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:37:42.461152 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-02e73dc8-ec20-4b31-af17-18a8f1a16a8c req-d4b0af27-d0b9-443c-a681-03a85ccb9e6c service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received unexpected event network-vif-plugged-53ab7bb3-88bd-4061-9d43-b6392e20c003 for instance with vm_state building and task_state spawning. Jun 26 10:37:42.462109 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Instance event wait completed in 0 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:37:42.475296 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Successfully created port: d8b51bcb-01d0-46b9-a5ff-b3335f560c00 {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:37:42.475296 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Guest created on hypervisor {{(pid=98967) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 26 10:37:42.476050 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Instance spawned successfully. Jun 26 10:37:42.476379 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 26 10:37:42.516493 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:42.524320 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:42.578383 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-545abb50-ebf5-43ff-b1f2-89d18881bfc2 req-ee55d279-d9f0-472e-ad4e-4c065a98aad1 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-plugged-f141a8bb-5a71-4872-b62f-9fce6052875a {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:42.578715 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-545abb50-ebf5-43ff-b1f2-89d18881bfc2 req-ee55d279-d9f0-472e-ad4e-4c065a98aad1 service nova] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:42.578811 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-545abb50-ebf5-43ff-b1f2-89d18881bfc2 req-ee55d279-d9f0-472e-ad4e-4c065a98aad1 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:42.578936 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-545abb50-ebf5-43ff-b1f2-89d18881bfc2 req-ee55d279-d9f0-472e-ad4e-4c065a98aad1 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:42.579102 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-545abb50-ebf5-43ff-b1f2-89d18881bfc2 req-ee55d279-d9f0-472e-ad4e-4c065a98aad1 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] No waiting events found dispatching network-vif-plugged-f141a8bb-5a71-4872-b62f-9fce6052875a {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:37:42.579255 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-545abb50-ebf5-43ff-b1f2-89d18881bfc2 req-ee55d279-d9f0-472e-ad4e-4c065a98aad1 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received unexpected event network-vif-plugged-f141a8bb-5a71-4872-b62f-9fce6052875a for instance with vm_state building and task_state spawning. Jun 26 10:37:42.665389 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:42.665566 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:42.665625 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No VIF found with MAC fa:16:3e:90:be:9c, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:37:42.666094 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Using config drive Jun 26 10:37:42.741544 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:42.743496 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:37:42.804149 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:37:42.804812 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:37:42.987560 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Found default for hw_cdrom_bus of ide {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:42.987774 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Found default for hw_disk_bus of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:42.988467 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Found default for hw_input_bus of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:42.988734 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Found default for hw_pointer_model of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:42.989568 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Found default for hw_video_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:42.990245 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Found default for hw_vif_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:43.173233 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:43.282808 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] During sync_power_state the instance has a pending task (spawning). Skip. Jun 26 10:37:43.282808 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Paused> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:43.282808 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] VM Paused (Lifecycle Event) Jun 26 10:37:43.346826 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:37:43.358072 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Successfully updated port: d8b51bcb-01d0-46b9-a5ff-b3335f560c00 {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:37:43.433140 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Creating config drive at /opt/stack/data/nova/instances/212147b0-26de-42cd-b43d-057ec8d61c72/disk.config Jun 26 10:37:43.433140 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Start spawning the instance on the hypervisor. {{(pid=98967) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 26 10:37:43.437726 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Creating instance directory {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 26 10:37:43.440750 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Creating image(s) Jun 26 10:37:43.444311 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "/opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:43.445373 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "/opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.003s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:43.449380 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "/opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.004s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:43.450043 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:43.462688 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:43.468844 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:43.493325 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:43.503799 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Took 26.74 seconds to spawn the instance on the hypervisor. Jun 26 10:37:43.504577 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:43.511634 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:43.526706 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/212147b0-26de-42cd-b43d-057ec8d61c72/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp13l2gq_9 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:43.545328 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:43.567405 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.101s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:43.567654 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:43.568748 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:43.569277 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:43.573078 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:43.574587 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:43.575045 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/212147b0-26de-42cd-b43d-057ec8d61c72/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp13l2gq_9" returned: 0 in 0.050s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:43.668053 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.093s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:43.668879 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk 1073741824 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:43.735648 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:43.752828 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:43.762939 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:43.764711 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:43.764923 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] VM Resumed (Lifecycle Event) Jun 26 10:37:43.779274 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk 1073741824" returned: 0 in 0.109s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:43.781175 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.212s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:43.781175 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:43.820100 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.918s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:43.820639 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Start building networks asynchronously for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 26 10:37:43.862255 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "refresh_cache-047061b2-340c-4cc9-899b-0744dad0081f" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:43.862255 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquired lock "refresh_cache-047061b2-340c-4cc9-899b-0744dad0081f" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:43.862255 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:37:43.880723 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.100s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:43.881069 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Checking if we can resize image /opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk. size=1073741824 {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 26 10:37:43.881334 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:43.901503 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:43.940957 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:43.989962 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:43.991154 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Cannot resize image /opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk to a smaller size. {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 26 10:37:43.991154 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Created local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 26 10:37:43.991497 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Ensure instance console log exists: /opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/console.log {{(pid=98967) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 26 10:37:43.991865 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:43.992225 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:43.999083 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:44.031784 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Took 39.08 seconds to build instance. Jun 26 10:37:44.051881 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Instance destroyed successfully. Jun 26 10:37:44.053466 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lazy-loading 'numa_topology' on Instance uuid 81a0f65d-2017-4275-aabe-88bc8c81225d {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:37:44.228749 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:44.241387 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:44.241697 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:44.267403 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:44.277750 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:44.282643 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:44.283614 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:37:44.330256 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Allocating IP information in the background. {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 26 10:37:44.330365 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] allocate_for_instance() {{(pid=98967) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 26 10:37:44.332682 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:44.332682 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:44.337152 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:44.361302 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-5f645cc9-7d67-4987-a846-c08a2d8d7f7c req-268d7e3d-5986-4a2f-b8bf-97375ef7959c service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Received event network-vif-unplugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:44.361302 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5f645cc9-7d67-4987-a846-c08a2d8d7f7c req-268d7e3d-5986-4a2f-b8bf-97375ef7959c service nova] Acquiring lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:44.361770 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5f645cc9-7d67-4987-a846-c08a2d8d7f7c req-268d7e3d-5986-4a2f-b8bf-97375ef7959c service nova] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:44.361770 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5f645cc9-7d67-4987-a846-c08a2d8d7f7c req-268d7e3d-5986-4a2f-b8bf-97375ef7959c service nova] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:44.361901 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-5f645cc9-7d67-4987-a846-c08a2d8d7f7c req-268d7e3d-5986-4a2f-b8bf-97375ef7959c service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] No waiting events found dispatching network-vif-unplugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:37:44.363837 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-5f645cc9-7d67-4987-a846-c08a2d8d7f7c req-268d7e3d-5986-4a2f-b8bf-97375ef7959c service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Received unexpected event network-vif-unplugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 for instance with vm_state active and task_state shelving. Jun 26 10:37:44.363837 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-5f645cc9-7d67-4987-a846-c08a2d8d7f7c req-268d7e3d-5986-4a2f-b8bf-97375ef7959c service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Received event network-vif-unplugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:44.363837 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5f645cc9-7d67-4987-a846-c08a2d8d7f7c req-268d7e3d-5986-4a2f-b8bf-97375ef7959c service nova] Acquiring lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:44.363837 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5f645cc9-7d67-4987-a846-c08a2d8d7f7c req-268d7e3d-5986-4a2f-b8bf-97375ef7959c service nova] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:44.363837 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5f645cc9-7d67-4987-a846-c08a2d8d7f7c req-268d7e3d-5986-4a2f-b8bf-97375ef7959c service nova] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:44.363837 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-5f645cc9-7d67-4987-a846-c08a2d8d7f7c req-268d7e3d-5986-4a2f-b8bf-97375ef7959c service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] No waiting events found dispatching network-vif-unplugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:37:44.364109 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-5f645cc9-7d67-4987-a846-c08a2d8d7f7c req-268d7e3d-5986-4a2f-b8bf-97375ef7959c service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Received unexpected event network-vif-unplugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 for instance with vm_state active and task_state shelving. Jun 26 10:37:44.364109 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-5f645cc9-7d67-4987-a846-c08a2d8d7f7c req-268d7e3d-5986-4a2f-b8bf-97375ef7959c service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Received event network-vif-plugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:44.364586 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5f645cc9-7d67-4987-a846-c08a2d8d7f7c req-268d7e3d-5986-4a2f-b8bf-97375ef7959c service nova] Acquiring lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:44.364783 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5f645cc9-7d67-4987-a846-c08a2d8d7f7c req-268d7e3d-5986-4a2f-b8bf-97375ef7959c service nova] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:44.364954 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5f645cc9-7d67-4987-a846-c08a2d8d7f7c req-268d7e3d-5986-4a2f-b8bf-97375ef7959c service nova] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:44.367574 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-5f645cc9-7d67-4987-a846-c08a2d8d7f7c req-268d7e3d-5986-4a2f-b8bf-97375ef7959c service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] No waiting events found dispatching network-vif-plugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:37:44.367899 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-5f645cc9-7d67-4987-a846-c08a2d8d7f7c req-268d7e3d-5986-4a2f-b8bf-97375ef7959c service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Received unexpected event network-vif-plugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 for instance with vm_state active and task_state shelving. Jun 26 10:37:44.375659 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:44.384843 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:44.428752 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:44.455411 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:44.456918 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:44.481460 np0000003731 nova-compute[98967]: DEBUG nova.policy [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '04176251e13046eb8cfc1908246d4d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a58b94e5ec406182da9117e14aa789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98967) authorize /opt/stack/nova/nova/policy.py:192}} Jun 26 10:37:44.485780 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:44.500777 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:37:44.533431 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 40.594s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:44.738521 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-27041a91-538f-43c5-a596-788227eaed40 req-b832f8e6-fa5a-4505-ae87-9751f2693499 service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Received event network-changed-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:44.741740 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-27041a91-538f-43c5-a596-788227eaed40 req-b832f8e6-fa5a-4505-ae87-9751f2693499 service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Refreshing instance network info cache due to event network-changed-d8b51bcb-01d0-46b9-a5ff-b3335f560c00. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:37:44.741886 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-27041a91-538f-43c5-a596-788227eaed40 req-b832f8e6-fa5a-4505-ae87-9751f2693499 service nova] Acquiring lock "refresh_cache-047061b2-340c-4cc9-899b-0744dad0081f" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:44.748452 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Beginning cold snapshot process Jun 26 10:37:44.788098 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:44.793677 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:44.797876 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:44.811400 np0000003731 nova-compute[98967]: DEBUG nova.utils [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Queued Task(fn=>, remaining_delay=14.999736830999836 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:37:44.811400 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.998836762999872 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:37:44.811400 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.998707281999941 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:37:44.851873 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 26 10:37:45.009154 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Updating instance_info_cache with network_info: [{"id": "d8b51bcb-01d0-46b9-a5ff-b3335f560c00", "address": "fa:16:3e:1b:55:09", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b51bcb-01", "ovs_interfaceid": "d8b51bcb-01d0-46b9-a5ff-b3335f560c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:45.148919 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Successfully created port: 13baed68-e3c0-4f72-8ccd-0cc2c4cd3552 {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:37:45.351337 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a6f6ed75-8542-42bb-bd6b-5b4e1561b9b2 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Acquiring lock "78222936-8bdc-4928-a30e-924af89fd8b9" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:45.351550 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a6f6ed75-8542-42bb-bd6b-5b4e1561b9b2 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Lock "78222936-8bdc-4928-a30e-924af89fd8b9" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:45.352322 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a6f6ed75-8542-42bb-bd6b-5b4e1561b9b2 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Acquiring lock "78222936-8bdc-4928-a30e-924af89fd8b9-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:45.352322 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a6f6ed75-8542-42bb-bd6b-5b4e1561b9b2 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Lock "78222936-8bdc-4928-a30e-924af89fd8b9-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:45.352322 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a6f6ed75-8542-42bb-bd6b-5b4e1561b9b2 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Lock "78222936-8bdc-4928-a30e-924af89fd8b9-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:45.353761 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Start building block device mappings for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 26 10:37:45.357308 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-a6f6ed75-8542-42bb-bd6b-5b4e1561b9b2 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Terminating instance Jun 26 10:37:45.515403 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Releasing lock "refresh_cache-047061b2-340c-4cc9-899b-0744dad0081f" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:45.515910 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Instance network_info: |[{"id": "d8b51bcb-01d0-46b9-a5ff-b3335f560c00", "address": "fa:16:3e:1b:55:09", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b51bcb-01", "ovs_interfaceid": "d8b51bcb-01d0-46b9-a5ff-b3335f560c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 26 10:37:45.517242 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-27041a91-538f-43c5-a596-788227eaed40 req-b832f8e6-fa5a-4505-ae87-9751f2693499 service nova] Acquired lock "refresh_cache-047061b2-340c-4cc9-899b-0744dad0081f" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:45.517242 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-27041a91-538f-43c5-a596-788227eaed40 req-b832f8e6-fa5a-4505-ae87-9751f2693499 service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Refreshing network info cache for port d8b51bcb-01d0-46b9-a5ff-b3335f560c00 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:37:45.518757 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Start _get_guest_xml network_info=[{"id": "d8b51bcb-01d0-46b9-a5ff-b3335f560c00", "address": "fa:16:3e:1b:55:09", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b51bcb-01", "ovs_interfaceid": "d8b51bcb-01d0-46b9-a5ff-b3335f560c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'image_id': 'a9b18127-6fee-4ed6-b364-a2d634ecb8b7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:37:45.521617 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:37:45.522847 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-464264811', uuid='047061b2-340c-4cc9-899b-0744dad0081f'), owner=OwnerMeta(userid='04176251e13046eb8cfc1908246d4d9d', username='tempest-ServerRescueNegativeTestJSON-1439990304-project-member', projectid='58a58b94e5ec406182da9117e14aa789', projectname='tempest-ServerRescueNegativeTestJSON-1439990304'), image=ImageMeta(id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d8b51bcb-01d0-46b9-a5ff-b3335f560c00", "address": "fa:16:3e:1b:55:09", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b51bcb-01", "ovs_interfaceid": "d8b51bcb-01d0-46b9-a5ff-b3335f560c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470265.522495) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:37:45.523998 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:37:45.524363 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:37:45.525369 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:37:45.525560 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:37:45.527551 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:37:45.530530 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:37:45.530530 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:37:45.530530 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:37:45.530530 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:37:45.530530 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:37:45.530530 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:37:45.530530 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:37:45.530530 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:37:45.530530 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:37:45.530530 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:37:45.530530 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:37:45.545992 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:37:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-464264811',display_name='tempest-ServerRescueNegativeTestJSON-server-464264811',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-serverrescuenegativetestjson-server-464264811',id=12,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='58a58b94e5ec406182da9117e14aa789',ramdisk_id='',reservation_id='r-or2m3uoy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1439990304',owner_user_name='tempest-ServerRescueNegativeTestJSON-1439990304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:42Z,user_data=None,user_id='04176251e13046eb8cfc1908246d4d9d',uuid=047061b2-340c-4cc9-899b-0744dad0081f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8b51bcb-01d0-46b9-a5ff-b3335f560c00", "address": "fa:16:3e:1b:55:09", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b51bcb-01", "ovs_interfaceid": "d8b51bcb-01d0-46b9-a5ff-b3335f560c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:37:45.546243 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Converting VIF {"id": "d8b51bcb-01d0-46b9-a5ff-b3335f560c00", "address": "fa:16:3e:1b:55:09", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b51bcb-01", "ovs_interfaceid": "d8b51bcb-01d0-46b9-a5ff-b3335f560c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:45.547274 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:55:09,bridge_name='br-int',has_traffic_filtering=True,id=d8b51bcb-01d0-46b9-a5ff-b3335f560c00,network=Network(d50baa85-72ef-4bb3-9676-e629d583d3a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8b51bcb-01') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:45.556034 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'pci_devices' on Instance uuid 047061b2-340c-4cc9-899b-0744dad0081f {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:37:45.861319 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-a6f6ed75-8542-42bb-bd6b-5b4e1561b9b2 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Start destroying the instance on the hypervisor. {{(pid=98967) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 26 10:37:45.909623 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:45.914256 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:45.934381 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:45.949730 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:45.983069 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:46.021039 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-27041a91-538f-43c5-a596-788227eaed40 req-b832f8e6-fa5a-4505-ae87-9751f2693499 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] End _get_guest_xml xml= Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: 047061b2-340c-4cc9-899b-0744dad0081f Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: instance-0000000c Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: 196608 Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: tempest-ServerRescueNegativeTestJSON-server-464264811 Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: 2026-06-26 10:37:45 Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: 192 Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: True Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: bare Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: virtio Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: tempest-ServerRescueNegativeTestJSON-1439990304-project-member Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: tempest-ServerRescueNegativeTestJSON-1439990304 Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: 047061b2-340c-4cc9-899b-0744dad0081f Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: 047061b2-340c-4cc9-899b-0744dad0081f Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: hvm Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: 128 Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: Jun 26 10:37:46.051621 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:37:46.057047 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Preparing to wait for external event network-vif-plugged-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:37:46.057047 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "047061b2-340c-4cc9-899b-0744dad0081f-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:46.057047 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "047061b2-340c-4cc9-899b-0744dad0081f-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:46.057047 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "047061b2-340c-4cc9-899b-0744dad0081f-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:46.057047 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:37:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-464264811',display_name='tempest-ServerRescueNegativeTestJSON-server-464264811',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-serverrescuenegativetestjson-server-464264811',id=12,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='58a58b94e5ec406182da9117e14aa789',ramdisk_id='',reservation_id='r-or2m3uoy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1439990304',owner_user_name='tempest-ServerRescueNegativeTestJSON-1439990304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:42Z,user_data=None,user_id='04176251e13046eb8cfc1908246d4d9d',uuid=047061b2-340c-4cc9-899b-0744dad0081f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "d8b51bcb-01d0-46b9-a5ff-b3335f560c00", "address": "fa:16:3e:1b:55:09", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b51bcb-01", "ovs_interfaceid": "d8b51bcb-01d0-46b9-a5ff-b3335f560c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:37:46.057047 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Converting VIF {"id": "d8b51bcb-01d0-46b9-a5ff-b3335f560c00", "address": "fa:16:3e:1b:55:09", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b51bcb-01", "ovs_interfaceid": "d8b51bcb-01d0-46b9-a5ff-b3335f560c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:46.057047 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:1b:55:09,bridge_name='br-int',has_traffic_filtering=True,id=d8b51bcb-01d0-46b9-a5ff-b3335f560c00,network=Network(d50baa85-72ef-4bb3-9676-e629d583d3a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8b51bcb-01') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:46.057047 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:55:09,bridge_name='br-int',has_traffic_filtering=True,id=d8b51bcb-01d0-46b9-a5ff-b3335f560c00,network=Network(d50baa85-72ef-4bb3-9676-e629d583d3a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8b51bcb-01') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:37:46.057047 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:46.057047 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:46.057047 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:37:46.057047 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:46.057047 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6d1e50ea-30f5-5bdb-b67f-e449cb7680de', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:46.057047 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:46.058074 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:46.070513 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:46.075911 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:46.075911 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapd8b51bcb-01, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:46.075911 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapd8b51bcb-01, col_values=(('qos', UUID('039c4a07-8337-4192-b553-2ae29fad6be1')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:46.075911 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapd8b51bcb-01, col_values=(('external_ids', {'iface-id': 'd8b51bcb-01d0-46b9-a5ff-b3335f560c00', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:1b:55:09', 'vm-uuid': '047061b2-340c-4cc9-899b-0744dad0081f'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:46.080539 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:46.083942 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:46.096415 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:46.096562 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] VM Started (Lifecycle Event) Jun 26 10:37:46.100616 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:46.102731 np0000003731 nova-compute[98967]: INFO os_vif [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:1b:55:09,bridge_name='br-int',has_traffic_filtering=True,id=d8b51bcb-01d0-46b9-a5ff-b3335f560c00,network=Network(d50baa85-72ef-4bb3-9676-e629d583d3a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8b51bcb-01') Jun 26 10:37:46.162951 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Successfully updated port: 13baed68-e3c0-4f72-8ccd-0cc2c4cd3552 {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:37:46.219487 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-565e162c-b592-44a7-af68-6d8778b735a6 req-c06bd2bd-40a1-411e-9da0-e0aef486e9c5 service nova] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Received event network-vif-unplugged-c82a5e66-4de5-45f5-aa1f-23cf9fb96c74 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:46.220233 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-565e162c-b592-44a7-af68-6d8778b735a6 req-c06bd2bd-40a1-411e-9da0-e0aef486e9c5 service nova] Acquiring lock "78222936-8bdc-4928-a30e-924af89fd8b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:46.220382 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-565e162c-b592-44a7-af68-6d8778b735a6 req-c06bd2bd-40a1-411e-9da0-e0aef486e9c5 service nova] Lock "78222936-8bdc-4928-a30e-924af89fd8b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:46.220526 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-565e162c-b592-44a7-af68-6d8778b735a6 req-c06bd2bd-40a1-411e-9da0-e0aef486e9c5 service nova] Lock "78222936-8bdc-4928-a30e-924af89fd8b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:46.220645 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-565e162c-b592-44a7-af68-6d8778b735a6 req-c06bd2bd-40a1-411e-9da0-e0aef486e9c5 service nova] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] No waiting events found dispatching network-vif-unplugged-c82a5e66-4de5-45f5-aa1f-23cf9fb96c74 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:37:46.220749 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-565e162c-b592-44a7-af68-6d8778b735a6 req-c06bd2bd-40a1-411e-9da0-e0aef486e9c5 service nova] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Received event network-vif-unplugged-c82a5e66-4de5-45f5-aa1f-23cf9fb96c74 for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:37:46.225910 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Instance destroyed successfully. Jun 26 10:37:46.226566 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-a6f6ed75-8542-42bb-bd6b-5b4e1561b9b2 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Lazy-loading 'resources' on Instance uuid 78222936-8bdc-4928-a30e-924af89fd8b9 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:37:46.266652 np0000003731 nova-compute[98967]: DEBUG nova.privsep.utils [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98967) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 26 10:37:46.266920 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d/disk /opt/stack/data/nova/instances/snapshots/tmp84w0_73q/7ad7f53501014e0099c21eea0c88d1d3 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:46.372775 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Start spawning the instance on the hypervisor. {{(pid=98967) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 26 10:37:46.375717 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Creating instance directory {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 26 10:37:46.377292 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Creating image(s) Jun 26 10:37:46.378123 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "/opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:46.378448 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "/opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:46.379634 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "/opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:46.380714 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:46.383776 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:46.392916 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Acquiring lock "c43215aa-be15-4556-8162-bcd9793048c0" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:46.392916 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "c43215aa-be15-4556-8162-bcd9793048c0" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:46.394621 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:46.430055 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-bde78009-4cfa-4c74-b7e3-f0c370097d62 req-04a8a676-443b-4ea2-8edc-f85362256be8 service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Received event network-vif-plugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:46.431259 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-bde78009-4cfa-4c74-b7e3-f0c370097d62 req-04a8a676-443b-4ea2-8edc-f85362256be8 service nova] Acquiring lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:46.431499 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-bde78009-4cfa-4c74-b7e3-f0c370097d62 req-04a8a676-443b-4ea2-8edc-f85362256be8 service nova] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:46.431959 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-bde78009-4cfa-4c74-b7e3-f0c370097d62 req-04a8a676-443b-4ea2-8edc-f85362256be8 service nova] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:46.432146 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-bde78009-4cfa-4c74-b7e3-f0c370097d62 req-04a8a676-443b-4ea2-8edc-f85362256be8 service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] No waiting events found dispatching network-vif-plugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:37:46.432634 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-bde78009-4cfa-4c74-b7e3-f0c370097d62 req-04a8a676-443b-4ea2-8edc-f85362256be8 service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Received unexpected event network-vif-plugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 for instance with vm_state active and task_state shelving_image_pending_upload. Jun 26 10:37:46.432634 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-bde78009-4cfa-4c74-b7e3-f0c370097d62 req-04a8a676-443b-4ea2-8edc-f85362256be8 service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Received event network-vif-unplugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:46.432634 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-bde78009-4cfa-4c74-b7e3-f0c370097d62 req-04a8a676-443b-4ea2-8edc-f85362256be8 service nova] Acquiring lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:46.432826 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-bde78009-4cfa-4c74-b7e3-f0c370097d62 req-04a8a676-443b-4ea2-8edc-f85362256be8 service nova] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:46.432865 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-bde78009-4cfa-4c74-b7e3-f0c370097d62 req-04a8a676-443b-4ea2-8edc-f85362256be8 service nova] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:46.433035 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-bde78009-4cfa-4c74-b7e3-f0c370097d62 req-04a8a676-443b-4ea2-8edc-f85362256be8 service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] No waiting events found dispatching network-vif-unplugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:37:46.433155 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-bde78009-4cfa-4c74-b7e3-f0c370097d62 req-04a8a676-443b-4ea2-8edc-f85362256be8 service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Received unexpected event network-vif-unplugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 for instance with vm_state active and task_state shelving_image_pending_upload. Jun 26 10:37:46.433258 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-bde78009-4cfa-4c74-b7e3-f0c370097d62 req-04a8a676-443b-4ea2-8edc-f85362256be8 service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Received event network-vif-unplugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:46.436268 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-bde78009-4cfa-4c74-b7e3-f0c370097d62 req-04a8a676-443b-4ea2-8edc-f85362256be8 service nova] Acquiring lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:46.436268 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-bde78009-4cfa-4c74-b7e3-f0c370097d62 req-04a8a676-443b-4ea2-8edc-f85362256be8 service nova] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:46.436268 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-bde78009-4cfa-4c74-b7e3-f0c370097d62 req-04a8a676-443b-4ea2-8edc-f85362256be8 service nova] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:46.436268 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-bde78009-4cfa-4c74-b7e3-f0c370097d62 req-04a8a676-443b-4ea2-8edc-f85362256be8 service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] No waiting events found dispatching network-vif-unplugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:37:46.436268 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-bde78009-4cfa-4c74-b7e3-f0c370097d62 req-04a8a676-443b-4ea2-8edc-f85362256be8 service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Received unexpected event network-vif-unplugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 for instance with vm_state active and task_state shelving_image_pending_upload. Jun 26 10:37:46.436268 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-bde78009-4cfa-4c74-b7e3-f0c370097d62 req-04a8a676-443b-4ea2-8edc-f85362256be8 service nova] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Received event network-changed-13baed68-e3c0-4f72-8ccd-0cc2c4cd3552 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:46.436268 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-bde78009-4cfa-4c74-b7e3-f0c370097d62 req-04a8a676-443b-4ea2-8edc-f85362256be8 service nova] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Refreshing instance network info cache due to event network-changed-13baed68-e3c0-4f72-8ccd-0cc2c4cd3552. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:37:46.436268 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-bde78009-4cfa-4c74-b7e3-f0c370097d62 req-04a8a676-443b-4ea2-8edc-f85362256be8 service nova] Acquiring lock "refresh_cache-25b12be8-e92b-4705-b668-05cfecaf66b3" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:46.436268 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-bde78009-4cfa-4c74-b7e3-f0c370097d62 req-04a8a676-443b-4ea2-8edc-f85362256be8 service nova] Acquired lock "refresh_cache-25b12be8-e92b-4705-b668-05cfecaf66b3" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:46.436268 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-bde78009-4cfa-4c74-b7e3-f0c370097d62 req-04a8a676-443b-4ea2-8edc-f85362256be8 service nova] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Refreshing network info cache for port 13baed68-e3c0-4f72-8ccd-0cc2c4cd3552 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:37:46.480052 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.085s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:46.480723 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:46.481403 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:46.481918 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:46.484772 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:37:46.485382 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:46.499910 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-27041a91-538f-43c5-a596-788227eaed40 req-b832f8e6-fa5a-4505-ae87-9751f2693499 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:46.556223 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.071s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:46.556689 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk 1073741824 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:46.591793 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d/disk /opt/stack/data/nova/instances/snapshots/tmp84w0_73q/7ad7f53501014e0099c21eea0c88d1d3" returned: 0 in 0.325s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:46.592271 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Snapshot extracted, beginning image upload Jun 26 10:37:46.595295 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk 1073741824" returned: 0 in 0.038s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:46.595689 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.114s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:46.595998 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:46.616411 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:46.620764 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Paused> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:46.620956 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] VM Paused (Lifecycle Event) Jun 26 10:37:46.668464 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "refresh_cache-25b12be8-e92b-4705-b668-05cfecaf66b3" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:46.682869 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-27041a91-538f-43c5-a596-788227eaed40 req-b832f8e6-fa5a-4505-ae87-9751f2693499 service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Updated VIF entry in instance network info cache for port d8b51bcb-01d0-46b9-a5ff-b3335f560c00. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:37:46.683451 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-27041a91-538f-43c5-a596-788227eaed40 req-b832f8e6-fa5a-4505-ae87-9751f2693499 service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Updating instance_info_cache with network_info: [{"id": "d8b51bcb-01d0-46b9-a5ff-b3335f560c00", "address": "fa:16:3e:1b:55:09", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b51bcb-01", "ovs_interfaceid": "d8b51bcb-01d0-46b9-a5ff-b3335f560c00", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:46.685583 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.089s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:46.686225 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Checking if we can resize image /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk. size=1073741824 {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 26 10:37:46.686518 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:46.732442 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-a6f6ed75-8542-42bb-bd6b-5b4e1561b9b2 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:37:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesAdminNegativeTest-server-1199412248',display_name='tempest-VolumesAdminNegativeTest-server-1199412248',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-volumesadminnegativetest-server-1199412248',id=10,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-26T10:37:39Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='57cde3a05e524fd5a92d89589351db78',ramdisk_id='',reservation_id='r-zuv41j31',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAdminNegativeTest-1830845743',owner_user_name='tempest-VolumesAdminNegativeTest-1830845743-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-26T10:37:40Z,user_data=None,user_id='3267390b3bbf4307a3a2f1586f14cc87',uuid=78222936-8bdc-4928-a30e-924af89fd8b9,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c82a5e66-4de5-45f5-aa1f-23cf9fb96c74", "address": "fa:16:3e:85:f9:31", "network": {"id": "5aba4cc4-933f-443e-a572-58eeebc7a665", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-142224289-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57cde3a05e524fd5a92d89589351db78", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82a5e66-4d", "ovs_interfaceid": "c82a5e66-4de5-45f5-aa1f-23cf9fb96c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 26 10:37:46.732442 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-a6f6ed75-8542-42bb-bd6b-5b4e1561b9b2 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Converting VIF {"id": "c82a5e66-4de5-45f5-aa1f-23cf9fb96c74", "address": "fa:16:3e:85:f9:31", "network": {"id": "5aba4cc4-933f-443e-a572-58eeebc7a665", "bridge": "br-int", "label": "tempest-VolumesAdminNegativeTest-142224289-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "57cde3a05e524fd5a92d89589351db78", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc82a5e66-4d", "ovs_interfaceid": "c82a5e66-4de5-45f5-aa1f-23cf9fb96c74", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:46.732442 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-a6f6ed75-8542-42bb-bd6b-5b4e1561b9b2 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:f9:31,bridge_name='br-int',has_traffic_filtering=True,id=c82a5e66-4de5-45f5-aa1f-23cf9fb96c74,network=Network(5aba4cc4-933f-443e-a572-58eeebc7a665),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc82a5e66-4d') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:46.733021 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-a6f6ed75-8542-42bb-bd6b-5b4e1561b9b2 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:f9:31,bridge_name='br-int',has_traffic_filtering=True,id=c82a5e66-4de5-45f5-aa1f-23cf9fb96c74,network=Network(5aba4cc4-933f-443e-a572-58eeebc7a665),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc82a5e66-4d') {{(pid=98967) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 26 10:37:46.734787 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:46.735232 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc82a5e66-4d, bridge=br-int, if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:46.736717 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:46.737718 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:46.748708 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:46.752441 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:46.752441 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=61d74c00-3db5-4537-9638-7e17e7b17532) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:46.752441 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:46.752441 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:46.763196 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:46.766319 np0000003731 nova-compute[98967]: INFO os_vif [None req-a6f6ed75-8542-42bb-bd6b-5b4e1561b9b2 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:f9:31,bridge_name='br-int',has_traffic_filtering=True,id=c82a5e66-4de5-45f5-aa1f-23cf9fb96c74,network=Network(5aba4cc4-933f-443e-a572-58eeebc7a665),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc82a5e66-4d') Jun 26 10:37:46.768939 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk --force-share --output=json" returned: 0 in 0.081s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:46.769395 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Cannot resize image /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk to a smaller size. {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 26 10:37:46.769765 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Created local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 26 10:37:46.769967 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Ensure instance console log exists: /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/console.log {{(pid=98967) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 26 10:37:46.770302 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-a6f6ed75-8542-42bb-bd6b-5b4e1561b9b2 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Deleting instance files /opt/stack/data/nova/instances/78222936-8bdc-4928-a30e-924af89fd8b9_del Jun 26 10:37:46.772025 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:46.772025 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:46.772025 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:46.772292 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-a6f6ed75-8542-42bb-bd6b-5b4e1561b9b2 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Deletion of /opt/stack/data/nova/instances/78222936-8bdc-4928-a30e-924af89fd8b9_del complete Jun 26 10:37:46.840499 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-393c471c-27f9-4083-876f-7a20a64a5492 req-9b1044fa-ce1a-4479-b827-693028085404 service nova] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Received event network-vif-plugged-32e8fd61-b6bb-41bf-80b8-c09e23741e03 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:46.840499 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-393c471c-27f9-4083-876f-7a20a64a5492 req-9b1044fa-ce1a-4479-b827-693028085404 service nova] Acquiring lock "212147b0-26de-42cd-b43d-057ec8d61c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:46.840499 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-393c471c-27f9-4083-876f-7a20a64a5492 req-9b1044fa-ce1a-4479-b827-693028085404 service nova] Lock "212147b0-26de-42cd-b43d-057ec8d61c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:46.840499 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-393c471c-27f9-4083-876f-7a20a64a5492 req-9b1044fa-ce1a-4479-b827-693028085404 service nova] Lock "212147b0-26de-42cd-b43d-057ec8d61c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:46.840499 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-393c471c-27f9-4083-876f-7a20a64a5492 req-9b1044fa-ce1a-4479-b827-693028085404 service nova] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Processing event network-vif-plugged-32e8fd61-b6bb-41bf-80b8-c09e23741e03 {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:37:46.840499 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-393c471c-27f9-4083-876f-7a20a64a5492 req-9b1044fa-ce1a-4479-b827-693028085404 service nova] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Received event network-vif-plugged-32e8fd61-b6bb-41bf-80b8-c09e23741e03 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:46.840499 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-393c471c-27f9-4083-876f-7a20a64a5492 req-9b1044fa-ce1a-4479-b827-693028085404 service nova] Acquiring lock "212147b0-26de-42cd-b43d-057ec8d61c72-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:46.840499 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-393c471c-27f9-4083-876f-7a20a64a5492 req-9b1044fa-ce1a-4479-b827-693028085404 service nova] Lock "212147b0-26de-42cd-b43d-057ec8d61c72-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:46.840499 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-393c471c-27f9-4083-876f-7a20a64a5492 req-9b1044fa-ce1a-4479-b827-693028085404 service nova] Lock "212147b0-26de-42cd-b43d-057ec8d61c72-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:46.840499 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-393c471c-27f9-4083-876f-7a20a64a5492 req-9b1044fa-ce1a-4479-b827-693028085404 service nova] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] No waiting events found dispatching network-vif-plugged-32e8fd61-b6bb-41bf-80b8-c09e23741e03 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:37:46.840983 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-393c471c-27f9-4083-876f-7a20a64a5492 req-9b1044fa-ce1a-4479-b827-693028085404 service nova] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Received unexpected event network-vif-plugged-32e8fd61-b6bb-41bf-80b8-c09e23741e03 for instance with vm_state building and task_state spawning. Jun 26 10:37:46.840983 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-393c471c-27f9-4083-876f-7a20a64a5492 req-9b1044fa-ce1a-4479-b827-693028085404 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-changed-38973918-1218-4531-8941-0e9fbff30e3e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:46.840983 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-393c471c-27f9-4083-876f-7a20a64a5492 req-9b1044fa-ce1a-4479-b827-693028085404 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Refreshing instance network info cache due to event network-changed-38973918-1218-4531-8941-0e9fbff30e3e. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:37:46.841080 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-393c471c-27f9-4083-876f-7a20a64a5492 req-9b1044fa-ce1a-4479-b827-693028085404 service nova] Acquiring lock "refresh_cache-a686feac-bebe-47c8-a3c8-f3c2260ca7f5" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:46.841220 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-393c471c-27f9-4083-876f-7a20a64a5492 req-9b1044fa-ce1a-4479-b827-693028085404 service nova] Acquired lock "refresh_cache-a686feac-bebe-47c8-a3c8-f3c2260ca7f5" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:46.842024 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-393c471c-27f9-4083-876f-7a20a64a5492 req-9b1044fa-ce1a-4479-b827-693028085404 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Refreshing network info cache for port 38973918-1218-4531-8941-0e9fbff30e3e {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:37:46.843629 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:37:46.846858 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Guest created on hypervisor {{(pid=98967) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 26 10:37:46.849257 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Instance spawned successfully. Jun 26 10:37:46.849621 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 26 10:37:46.896589 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lazy-loading 'flavor' on Instance uuid c43215aa-be15-4556-8162-bcd9793048c0 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:37:46.937773 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-bde78009-4cfa-4c74-b7e3-f0c370097d62 req-04a8a676-443b-4ea2-8edc-f85362256be8 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:46.999951 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-bde78009-4cfa-4c74-b7e3-f0c370097d62 req-04a8a676-443b-4ea2-8edc-f85362256be8 service nova] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:37:47.126027 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:47.126909 np0000003731 nova-compute[98967]: DEBUG nova.utils [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Queued Task(fn=>, remaining_delay=14.999791622999965 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:37:47.127111 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:47.127257 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] VM Resumed (Lifecycle Event) Jun 26 10:37:47.140682 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-bde78009-4cfa-4c74-b7e3-f0c370097d62 req-04a8a676-443b-4ea2-8edc-f85362256be8 service nova] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:47.185453 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-27041a91-538f-43c5-a596-788227eaed40 req-b832f8e6-fa5a-4505-ae87-9751f2693499 service nova] Releasing lock "refresh_cache-047061b2-340c-4cc9-899b-0744dad0081f" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:47.280418 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-a6f6ed75-8542-42bb-bd6b-5b4e1561b9b2 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Took 1.42 seconds to destroy the instance on the hypervisor. Jun 26 10:37:47.289227 np0000003731 nova-compute[98967]: DEBUG oslo.service.backend._common.loopingcall [None req-a6f6ed75-8542-42bb-bd6b-5b4e1561b9b2 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98967) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 26 10:37:47.289961 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [-] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Deallocating network for instance {{(pid=98967) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 26 10:37:47.293038 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [-] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] deallocate_for_instance() {{(pid=98967) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 26 10:37:47.293038 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:47.344597 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-393c471c-27f9-4083-876f-7a20a64a5492 req-9b1044fa-ce1a-4479-b827-693028085404 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:47.355434 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Found default for hw_cdrom_bus of ide {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:47.355625 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Found default for hw_disk_bus of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:47.355841 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Found default for hw_input_bus of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:47.356106 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Found default for hw_pointer_model of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:47.356723 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Found default for hw_video_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:47.356991 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Found default for hw_vif_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:47.381387 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:47.409903 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:47.630366 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:47.635953 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:37:47.645099 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-bde78009-4cfa-4c74-b7e3-f0c370097d62 req-04a8a676-443b-4ea2-8edc-f85362256be8 service nova] Releasing lock "refresh_cache-25b12be8-e92b-4705-b668-05cfecaf66b3" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:47.645820 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquired lock "refresh_cache-25b12be8-e92b-4705-b668-05cfecaf66b3" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:47.646014 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:37:47.655695 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:47.657413 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:47.657607 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] No VIF found with MAC fa:16:3e:1b:55:09, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:37:47.658111 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Using config drive Jun 26 10:37:47.877039 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Took 8.98 seconds to spawn the instance on the hypervisor. Jun 26 10:37:47.877319 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:47.902589 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "c43215aa-be15-4556-8162-bcd9793048c0" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.511s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:47.996447 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-393c471c-27f9-4083-876f-7a20a64a5492 req-9b1044fa-ce1a-4479-b827-693028085404 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:48.128879 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-393c471c-27f9-4083-876f-7a20a64a5492 req-9b1044fa-ce1a-4479-b827-693028085404 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Updated VIF entry in instance network info cache for port 38973918-1218-4531-8941-0e9fbff30e3e. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:37:48.129732 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-393c471c-27f9-4083-876f-7a20a64a5492 req-9b1044fa-ce1a-4479-b827-693028085404 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Updating instance_info_cache with network_info: [{"id": "38973918-1218-4531-8941-0e9fbff30e3e", "address": "fa:16:3e:98:a5:6d", "network": {"id": "cc7daed3-e035-41b4-99f9-fb4b79e0045d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1956118171-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38973918-12", "ovs_interfaceid": "38973918-1218-4531-8941-0e9fbff30e3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "99b479ce-38b6-464c-a476-7039543e31d9", "address": "fa:16:3e:9b:2a:95", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b479ce-38", "ovs_interfaceid": "99b479ce-38b6-464c-a476-7039543e31d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "a8a13bff-3694-4c1e-a5ae-486d72b71662", "address": "fa:16:3e:0d:e8:58", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a13bff-36", "ovs_interfaceid": "a8a13bff-3694-4c1e-a5ae-486d72b71662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "f141a8bb-5a71-4872-b62f-9fce6052875a", "address": "fa:16:3e:89:3b:98", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf141a8bb-5a", "ovs_interfaceid": "f141a8bb-5a71-4872-b62f-9fce6052875a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "fa54a649-79c1-4413-91b2-680216f8b045", "address": "fa:16:3e:4e:45:ca", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa54a649-79", "ovs_interfaceid": "fa54a649-79c1-4413-91b2-680216f8b045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a", "address": "fa:16:3e:fc:62:66", "network": {"id": "35589be9-ff77-40f5-8d6f-20e36bb2cd03", "bridge": "br-int", "label": "tempest-device-tagging-net2-1172567199", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0f4a94-bf", "ovs_interfaceid": "4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "53ab7bb3-88bd-4061-9d43-b6392e20c003", "address": "fa:16:3e:50:56:3a", "network": {"id": "35589be9-ff77-40f5-8d6f-20e36bb2cd03", "bridge": "br-int", "label": "tempest-device-tagging-net2-1172567199", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ab7bb3-88", "ovs_interfaceid": "53ab7bb3-88bd-4061-9d43-b6392e20c003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:48.138983 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] During sync_power_state the instance has a pending task (spawning). Skip. Jun 26 10:37:48.164361 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:48.246340 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:37:48.292416 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-d51bd4d0-06d4-4a50-95ef-b9f581400e61 req-4a4f4327-8081-40ea-b7a8-996e3de4275e service nova] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Received event network-vif-unplugged-c82a5e66-4de5-45f5-aa1f-23cf9fb96c74 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:48.292416 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-d51bd4d0-06d4-4a50-95ef-b9f581400e61 req-4a4f4327-8081-40ea-b7a8-996e3de4275e service nova] Acquiring lock "78222936-8bdc-4928-a30e-924af89fd8b9-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:48.292416 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-d51bd4d0-06d4-4a50-95ef-b9f581400e61 req-4a4f4327-8081-40ea-b7a8-996e3de4275e service nova] Lock "78222936-8bdc-4928-a30e-924af89fd8b9-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:48.292416 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-d51bd4d0-06d4-4a50-95ef-b9f581400e61 req-4a4f4327-8081-40ea-b7a8-996e3de4275e service nova] Lock "78222936-8bdc-4928-a30e-924af89fd8b9-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:48.292416 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-d51bd4d0-06d4-4a50-95ef-b9f581400e61 req-4a4f4327-8081-40ea-b7a8-996e3de4275e service nova] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] No waiting events found dispatching network-vif-unplugged-c82a5e66-4de5-45f5-aa1f-23cf9fb96c74 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:37:48.292416 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-d51bd4d0-06d4-4a50-95ef-b9f581400e61 req-4a4f4327-8081-40ea-b7a8-996e3de4275e service nova] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Received event network-vif-unplugged-c82a5e66-4de5-45f5-aa1f-23cf9fb96c74 for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:37:48.353154 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Creating config drive at /opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk.config Jun 26 10:37:48.357189 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8lay6dxw {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:48.381527 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [-] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:48.391957 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Took 14.61 seconds to build instance. Jun 26 10:37:48.415198 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp8lay6dxw" returned: 0 in 0.058s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:48.436773 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:48.618753 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Updating instance_info_cache with network_info: [{"id": "13baed68-e3c0-4f72-8ccd-0cc2c4cd3552", "address": "fa:16:3e:5a:81:1a", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13baed68-e3", "ovs_interfaceid": "13baed68-e3c0-4f72-8ccd-0cc2c4cd3552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:48.633232 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-393c471c-27f9-4083-876f-7a20a64a5492 req-9b1044fa-ce1a-4479-b827-693028085404 service nova] Releasing lock "refresh_cache-a686feac-bebe-47c8-a3c8-f3c2260ca7f5" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:48.894193 np0000003731 nova-compute[98967]: INFO nova.compute.manager [-] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Took 1.60 seconds to deallocate network for instance. Jun 26 10:37:48.894964 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d286dfdd-95d7-47a4-a2da-fb46f647eaa4 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "212147b0-26de-42cd-b43d-057ec8d61c72" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 16.121s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:48.911266 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:48.924456 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-be2a7739-c2a5-4250-ac21-0d1599cd7cbf req-04ad4226-618d-415a-a387-fbec28985645 service nova] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Received event network-vif-deleted-c82a5e66-4de5-45f5-aa1f-23cf9fb96c74 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:48.944246 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:49.046502 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:49.121596 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Releasing lock "refresh_cache-25b12be8-e92b-4705-b668-05cfecaf66b3" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:49.121596 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Instance network_info: |[{"id": "13baed68-e3c0-4f72-8ccd-0cc2c4cd3552", "address": "fa:16:3e:5a:81:1a", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13baed68-e3", "ovs_interfaceid": "13baed68-e3c0-4f72-8ccd-0cc2c4cd3552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 26 10:37:49.124058 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Start _get_guest_xml network_info=[{"id": "13baed68-e3c0-4f72-8ccd-0cc2c4cd3552", "address": "fa:16:3e:5a:81:1a", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13baed68-e3", "ovs_interfaceid": "13baed68-e3c0-4f72-8ccd-0cc2c4cd3552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'image_id': 'a9b18127-6fee-4ed6-b364-a2d634ecb8b7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:37:49.128550 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:37:49.129112 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1611932593', uuid='25b12be8-e92b-4705-b668-05cfecaf66b3'), owner=OwnerMeta(userid='04176251e13046eb8cfc1908246d4d9d', username='tempest-ServerRescueNegativeTestJSON-1439990304-project-member', projectid='58a58b94e5ec406182da9117e14aa789', projectname='tempest-ServerRescueNegativeTestJSON-1439990304'), image=ImageMeta(id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "13baed68-e3c0-4f72-8ccd-0cc2c4cd3552", "address": "fa:16:3e:5a:81:1a", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13baed68-e3", "ovs_interfaceid": "13baed68-e3c0-4f72-8ccd-0cc2c4cd3552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470269.1285932) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:37:49.132551 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:37:49.132551 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:37:49.133517 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:37:49.133764 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:37:49.135082 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:37:49.136025 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:37:49.136025 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:37:49.136025 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:37:49.136289 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:37:49.136289 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:37:49.136372 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:37:49.136575 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:37:49.136761 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:37:49.137668 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:37:49.137668 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:37:49.137668 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:37:49.158116 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:37:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1611932593',display_name='tempest-ServerRescueNegativeTestJSON-server-1611932593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-serverrescuenegativetestjson-server-1611932593',id=13,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='58a58b94e5ec406182da9117e14aa789',ramdisk_id='',reservation_id='r-0hfv2xzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1439990304',owner_user_name='tempest-ServerRescueNegativeTestJSON-1439990304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:45Z,user_data=None,user_id='04176251e13046eb8cfc1908246d4d9d',uuid=25b12be8-e92b-4705-b668-05cfecaf66b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13baed68-e3c0-4f72-8ccd-0cc2c4cd3552", "address": "fa:16:3e:5a:81:1a", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13baed68-e3", "ovs_interfaceid": "13baed68-e3c0-4f72-8ccd-0cc2c4cd3552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:37:49.158678 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Converting VIF {"id": "13baed68-e3c0-4f72-8ccd-0cc2c4cd3552", "address": "fa:16:3e:5a:81:1a", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13baed68-e3", "ovs_interfaceid": "13baed68-e3c0-4f72-8ccd-0cc2c4cd3552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:49.160397 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:81:1a,bridge_name='br-int',has_traffic_filtering=True,id=13baed68-e3c0-4f72-8ccd-0cc2c4cd3552,network=Network(d50baa85-72ef-4bb3-9676-e629d583d3a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13baed68-e3') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:49.162752 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'pci_devices' on Instance uuid 25b12be8-e92b-4705-b668-05cfecaf66b3 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:37:49.311601 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:49.318711 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:49.324743 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:49.351711 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:49.360384 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:49.408382 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a6f6ed75-8542-42bb-bd6b-5b4e1561b9b2 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:49.408869 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a6f6ed75-8542-42bb-bd6b-5b4e1561b9b2 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:49.504402 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Acquiring lock "c43215aa-be15-4556-8162-bcd9793048c0" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:49.504558 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "c43215aa-be15-4556-8162-bcd9793048c0" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:49.505876 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Attaching volume 321f2425-a565-4fff-b79c-993dfe4e9d92 to /dev/sdc Jun 26 10:37:49.560578 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.79', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003731', 'execute': None}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:37:49.581028 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.scaleio [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98967) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 10:37:49.602660 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Running cmd (subprocess): nvme version {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:49.633861 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] 'nvme version' failed. Not Retrying. {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 10:37:49.635105 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.nvmeof [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] nvme not present on system {{(pid=98967) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 10:37:49.647030 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98967) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 10:37:49.647030 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.lightos [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Current host hostNQN and IP(s) are ['10.4.3.79', 'fe80::f816:3eff:fe55:ba34', '192.168.40.6', 'fe80::f816:3eff:fe6b:fe1a', '192.168.50.6', 'fe80::f816:3eff:feca:9cd0', '192.168.10.6', 'fe80::f816:3eff:feb4:4e78', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f8bb:38ff:fe28:ff4a', 'fe80::fc16:3eff:fe56:c774', 'fe80::a4ca:b5ff:fe12:2c3c', 'fe80::fc16:3eff:fe37:b3f6', 'fe80::41a:feff:fe02:479d', 'fe80::fc16:3eff:fef2:11a', 'fe80::a061:7eff:feb6:8085', 'fe80::fc16:3eff:fe4b:6e75', 'fe80::fc16:3eff:fe3a:ece4', 'fe80::60f0:e4ff:fe6b:bf4c', 'fe80::fc16:3eff:fe5e:459', 'fe80::fc16:3eff:fe98:a56d', 'fe80::e0a3:7bff:fe72:d1ac', 'fe80::fc16:3eff:fe9b:2a95', 'fe80::fc16:3eff:fe0d:e858', 'fe80::fc16:3eff:fe89:3b98', 'fe80::fc16:3eff:fe4e:45ca', 'fe80::fc16:3eff:fefc:6266', 'fe80::c0fa:55ff:febf:197a', 'fe80::fc16:3eff:fe50:563a', 'fe80::8082:55ff:feee:9f56', 'fe80::fc16:3eff:fe90:be9c', 'fe80::fc16:3eff:fe1b:5509', 'fe80::84cb:23ff:fe8e:e6e6'] Jun 26 10:37:49.647319 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 10:37:49.647571 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] LIGHTOS: no hostnqn found. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 10:37:49.647865 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] <== get_connector_properties: return (87ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.79', 'host': 'np0000003731', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:2fddcc2116d6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '7f2a0776-2f14-4357-a22e-baa6677eb22e', 'nvme_native_multipath': False} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:37:49.648259 np0000003731 nova-compute[98967]: DEBUG nova.virt.block_device [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Updating existing volume attachment record: 683609c7-1c8a-4f43-aa62-610eb9c940d5 {{(pid=98967) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] End _get_guest_xml xml= Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: 25b12be8-e92b-4705-b668-05cfecaf66b3 Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: instance-0000000d Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: 196608 Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: tempest-ServerRescueNegativeTestJSON-server-1611932593 Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: 2026-06-26 10:37:49 Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: 192 Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: True Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: bare Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: 0 Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: virtio Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: tempest-ServerRescueNegativeTestJSON-1439990304-project-member Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: tempest-ServerRescueNegativeTestJSON-1439990304 Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: 25b12be8-e92b-4705-b668-05cfecaf66b3 Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: 25b12be8-e92b-4705-b668-05cfecaf66b3 Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: hvm Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: 128 Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: 1 Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: Jun 26 10:37:49.666347 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:37:49.669232 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Preparing to wait for external event network-vif-plugged-13baed68-e3c0-4f72-8ccd-0cc2c4cd3552 {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:37:49.669232 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "25b12be8-e92b-4705-b668-05cfecaf66b3-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:49.669425 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "25b12be8-e92b-4705-b668-05cfecaf66b3-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:49.669872 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "25b12be8-e92b-4705-b668-05cfecaf66b3-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:49.672679 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:37:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1611932593',display_name='tempest-ServerRescueNegativeTestJSON-server-1611932593',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-serverrescuenegativetestjson-server-1611932593',id=13,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='58a58b94e5ec406182da9117e14aa789',ramdisk_id='',reservation_id='r-0hfv2xzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1439990304',owner_user_name='tempest-ServerRescueNegativeTestJSON-1439990304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:45Z,user_data=None,user_id='04176251e13046eb8cfc1908246d4d9d',uuid=25b12be8-e92b-4705-b668-05cfecaf66b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "13baed68-e3c0-4f72-8ccd-0cc2c4cd3552", "address": "fa:16:3e:5a:81:1a", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13baed68-e3", "ovs_interfaceid": "13baed68-e3c0-4f72-8ccd-0cc2c4cd3552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:37:49.672909 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Converting VIF {"id": "13baed68-e3c0-4f72-8ccd-0cc2c4cd3552", "address": "fa:16:3e:5a:81:1a", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13baed68-e3", "ovs_interfaceid": "13baed68-e3c0-4f72-8ccd-0cc2c4cd3552", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:49.673640 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:5a:81:1a,bridge_name='br-int',has_traffic_filtering=True,id=13baed68-e3c0-4f72-8ccd-0cc2c4cd3552,network=Network(d50baa85-72ef-4bb3-9676-e629d583d3a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13baed68-e3') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:49.673879 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:81:1a,bridge_name='br-int',has_traffic_filtering=True,id=13baed68-e3c0-4f72-8ccd-0cc2c4cd3552,network=Network(d50baa85-72ef-4bb3-9676-e629d583d3a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13baed68-e3') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:37:49.676350 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:49.676691 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:49.677032 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:37:49.678352 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:49.678515 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6fcad8d5-59e2-51ba-990a-d9c3c9d2d2c8', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:49.679319 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:49.679981 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:49.687923 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:49.692260 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:49.692558 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap13baed68-e3, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:49.693093 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap13baed68-e3, col_values=(('qos', UUID('b5779f30-9230-48db-9f26-254f57f2e22b')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:49.693350 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap13baed68-e3, col_values=(('external_ids', {'iface-id': '13baed68-e3c0-4f72-8ccd-0cc2c4cd3552', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:5a:81:1a', 'vm-uuid': '25b12be8-e92b-4705-b668-05cfecaf66b3'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:49.700044 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:49.705046 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:49.711859 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:49.713364 np0000003731 nova-compute[98967]: INFO os_vif [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:5a:81:1a,bridge_name='br-int',has_traffic_filtering=True,id=13baed68-e3c0-4f72-8ccd-0cc2c4cd3552,network=Network(d50baa85-72ef-4bb3-9676-e629d583d3a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13baed68-e3') Jun 26 10:37:49.717353 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b3a8e498-68fd-4e15-9d14-86cf8175718c req-e0310c59-6a35-41c7-9bb0-075798823970 service nova] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Received event network-changed-09c4d8fd-840e-4d7a-98c9-f3422893bbba {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:49.717522 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b3a8e498-68fd-4e15-9d14-86cf8175718c req-e0310c59-6a35-41c7-9bb0-075798823970 service nova] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Refreshing instance network info cache due to event network-changed-09c4d8fd-840e-4d7a-98c9-f3422893bbba. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:37:49.717719 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b3a8e498-68fd-4e15-9d14-86cf8175718c req-e0310c59-6a35-41c7-9bb0-075798823970 service nova] Acquiring lock "refresh_cache-4b4a4a7e-d584-427e-91d2-7d9e710ea2a3" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:49.721716 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b3a8e498-68fd-4e15-9d14-86cf8175718c req-e0310c59-6a35-41c7-9bb0-075798823970 service nova] Acquired lock "refresh_cache-4b4a4a7e-d584-427e-91d2-7d9e710ea2a3" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:49.721716 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-b3a8e498-68fd-4e15-9d14-86cf8175718c req-e0310c59-6a35-41c7-9bb0-075798823970 service nova] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Refreshing network info cache for port 09c4d8fd-840e-4d7a-98c9-f3422893bbba {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:37:49.997939 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:49.998255 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] VM Started (Lifecycle Event) Jun 26 10:37:50.222144 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-b3a8e498-68fd-4e15-9d14-86cf8175718c req-e0310c59-6a35-41c7-9bb0-075798823970 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:50.232196 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Calling os-brick to attach iSCSI Volume {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 26 10:37:50.232988 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92', 'iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '321f2425-a565-4fff-b79c-993dfe4e9d92', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:37:50.232988 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:37:50.232988 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:37:50.233314 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92', 'iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '321f2425-a565-4fff-b79c-993dfe4e9d92', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 10:37:50.245369 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:37:50.246599 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:37:50.247093 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:37:50.247310 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:37:50.247751 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:37:50.247972 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:37:50.258906 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:37:50.258906 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:50.266450 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:37:50.266450 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:50.275677 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92] added Jun 26 10:37:50.275677 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:37:50.275677 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:37:50.275677 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:37:50.275677 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:37:50.275677 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:37:50.275677 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:50.275880 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:37:50.276199 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0288(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:37:50.276380 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:37:50.284834 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92] added Jun 26 10:37:50.284834 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:37:50.284834 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:37:50.284834 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:37:50.284834 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:37:50.284834 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:37:50.284834 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:50.284834 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:37:50.284834 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0366(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:37:50.284834 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:37:50.290876 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Snapshot image upload complete Jun 26 10:37:50.291185 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:50.302449 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-a6f6ed75-8542-42bb-bd6b-5b4e1561b9b2 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:37:50.303248 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-a6f6ed75-8542-42bb-bd6b-5b4e1561b9b2 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:37:50.503315 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:50.507028 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Paused> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:50.507216 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] VM Paused (Lifecycle Event) Jun 26 10:37:50.568153 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-b3a8e498-68fd-4e15-9d14-86cf8175718c req-e0310c59-6a35-41c7-9bb0-075798823970 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:50.693140 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-b3a8e498-68fd-4e15-9d14-86cf8175718c req-e0310c59-6a35-41c7-9bb0-075798823970 service nova] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Updated VIF entry in instance network info cache for port 09c4d8fd-840e-4d7a-98c9-f3422893bbba. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:37:50.693504 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-b3a8e498-68fd-4e15-9d14-86cf8175718c req-e0310c59-6a35-41c7-9bb0-075798823970 service nova] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Updating instance_info_cache with network_info: [{"id": "09c4d8fd-840e-4d7a-98c9-f3422893bbba", "address": "fa:16:3e:5e:04:59", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap09c4d8fd-84", "ovs_interfaceid": "09c4d8fd-840e-4d7a-98c9-f3422893bbba", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:50.798354 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Shelve offloading Jun 26 10:37:50.807032 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-a6f6ed75-8542-42bb-bd6b-5b4e1561b9b2 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:37:50.989598 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:50.989982 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:51.012496 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Received event network-vif-plugged-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:51.013443 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:51.013642 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] Acquiring lock "047061b2-340c-4cc9-899b-0744dad0081f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:51.013879 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] Lock "047061b2-340c-4cc9-899b-0744dad0081f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:51.014120 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] Lock "047061b2-340c-4cc9-899b-0744dad0081f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:51.014364 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Processing event network-vif-plugged-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:37:51.014501 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Received event network-vif-plugged-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:51.014640 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] Acquiring lock "047061b2-340c-4cc9-899b-0744dad0081f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:51.014915 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] Lock "047061b2-340c-4cc9-899b-0744dad0081f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:51.015119 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] Lock "047061b2-340c-4cc9-899b-0744dad0081f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:51.015354 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] No waiting events found dispatching network-vif-plugged-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:37:51.015571 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Received unexpected event network-vif-plugged-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 for instance with vm_state building and task_state spawning. Jun 26 10:37:51.015943 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Received event network-changed-2608654f-5761-4d82-a2ab-2a67e20a1c08 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:51.016129 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Refreshing instance network info cache due to event network-changed-2608654f-5761-4d82-a2ab-2a67e20a1c08. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:37:51.016837 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:37:51.018235 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:37:51.019231 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] Acquiring lock "refresh_cache-64a636b4-e106-4968-8740-9938e9b2bcc8" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:51.019398 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] Acquired lock "refresh_cache-64a636b4-e106-4968-8740-9938e9b2bcc8" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:51.019552 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Refreshing network info cache for port 2608654f-5761-4d82-a2ab-2a67e20a1c08 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:37:51.025259 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Guest created on hypervisor {{(pid=98967) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 26 10:37:51.025981 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Instance spawned successfully. Jun 26 10:37:51.026383 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 26 10:37:51.195046 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b3a8e498-68fd-4e15-9d14-86cf8175718c req-e0310c59-6a35-41c7-9bb0-075798823970 service nova] Releasing lock "refresh_cache-4b4a4a7e-d584-427e-91d2-7d9e710ea2a3" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:51.247077 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:51.247229 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:51.247381 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] No VIF found with MAC fa:16:3e:5a:81:1a, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:37:51.247812 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Using config drive Jun 26 10:37:51.276765 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:37:51.287419 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.40.100 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:37:51.292724 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.50.100 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:37:51.300512 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:51.306808 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Instance destroyed successfully. Jun 26 10:37:51.307329 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:51.307700 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:51.308445 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "refresh_cache-81a0f65d-2017-4275-aabe-88bc8c81225d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:51.308562 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquired lock "refresh_cache-81a0f65d-2017-4275-aabe-88bc8c81225d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:51.308766 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:37:51.311725 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a6f6ed75-8542-42bb-bd6b-5b4e1561b9b2 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.903s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:51.317032 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:51.325131 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:51.325131 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:51.325131 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:51.325131 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:51.325131 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:51.325131 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:51.325131 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:51.325131 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:51.325131 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:51.325516 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:51.325516 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:51.325516 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:51.325516 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:51.325516 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:51.325516 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:51.325516 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:51.325516 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:51.325516 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:51.334034 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:51.334034 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:51.334034 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:51.334034 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:51.334034 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:51.334034 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:51.334034 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:51.334034 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:51.334034 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:51.334422 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:51.334422 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:51.334422 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:51.334422 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:51.334422 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:51.334422 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:51.334422 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:51.334422 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:51.334422 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:51.378031 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92, portal: 192.168.40.100,3260] Jun 26 10:37:51.378031 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92, portal: 192.168.40.100,3260] successful. Jun 26 10:37:51.378031 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:51.388814 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:51.402455 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92, portal: 192.168.50.100,3260] Jun 26 10:37:51.402455 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92, portal: 192.168.50.100,3260] successful. Jun 26 10:37:51.402455 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:51.407914 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:51.407914 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:51.407914 np0000003731 nova-compute[98967]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:51.407914 np0000003731 nova-compute[98967]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:51.407914 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:51.407914 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:51.407914 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:51.407914 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:51.407914 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:51.407914 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:51.407914 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:51.408289 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:51.408289 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:51.408289 np0000003731 nova-compute[98967]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:51.408289 np0000003731 nova-compute[98967]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:51.408289 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:51.408289 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:51.408289 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:51.408289 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:51.408289 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:51.408289 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:51.408289 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:51.408543 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.161s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:37:51.408543 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Connected to 192.168.40.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:37:51.409729 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] HCTL ('15', '-', '-', 0) found on session 12 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:37:51.409864 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:37:51.414291 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:51.424574 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Searching for a device in session 12 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:37:51.424657 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '321f2425-a565-4fff-b79c-993dfe4e9d92', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:37:51.434714 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:51.434714 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:51.434714 np0000003731 nova-compute[98967]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:51.434714 np0000003731 nova-compute[98967]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:51.434714 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:51.434714 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:51.434714 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:51.434714 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:51.434714 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:51.434714 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:51.434714 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:51.435034 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:51.435034 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:51.435034 np0000003731 nova-compute[98967]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:51.435034 np0000003731 nova-compute[98967]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:51.435034 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:51.435034 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:51.435034 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:51.435034 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:51.435034 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:51.435034 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:51.435034 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:51.435231 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.187s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:37:51.435231 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Connected to 192.168.50.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:37:51.436205 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] HCTL ('16', '-', '-', 0) found on session 13 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:37:51.436310 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:37:51.453869 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Searching for a device in session 13 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:37:51.453869 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '321f2425-a565-4fff-b79c-993dfe4e9d92', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:37:51.459499 np0000003731 nova-compute[98967]: INFO nova.scheduler.client.report [None req-a6f6ed75-8542-42bb-bd6b-5b4e1561b9b2 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Deleted allocations for instance 78222936-8bdc-4928-a30e-924af89fd8b9 Jun 26 10:37:51.493030 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lazy-loading 'flavor' on Instance uuid 0b93909a-db10-4b65-b5a7-0aa3f0a47da7 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:37:51.521414 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] During sync_power_state the instance has a pending task (spawning). Skip. Jun 26 10:37:51.521634 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:51.521809 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] VM Resumed (Lifecycle Event) Jun 26 10:37:51.523869 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:51.533629 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Found default for hw_cdrom_bus of ide {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:51.533783 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Found default for hw_disk_bus of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:51.534108 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Found default for hw_input_bus of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:51.534809 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Found default for hw_pointer_model of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:51.534809 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Found default for hw_video_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:51.540555 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Found default for hw_vif_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:51.646901 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "4b4a4a7e-d584-427e-91d2-7d9e710ea2a3" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:51.647209 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "4b4a4a7e-d584-427e-91d2-7d9e710ea2a3" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:51.752233 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:51.801848 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-9dcfb745-e680-4dc2-9329-95ba374784be req-b7044bab-1901-46ac-9fb5-1ddd95900bd9 service nova] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Received event network-changed-32e8fd61-b6bb-41bf-80b8-c09e23741e03 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:51.801848 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-9dcfb745-e680-4dc2-9329-95ba374784be req-b7044bab-1901-46ac-9fb5-1ddd95900bd9 service nova] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Refreshing instance network info cache due to event network-changed-32e8fd61-b6bb-41bf-80b8-c09e23741e03. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:37:51.801848 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-9dcfb745-e680-4dc2-9329-95ba374784be req-b7044bab-1901-46ac-9fb5-1ddd95900bd9 service nova] Acquiring lock "refresh_cache-212147b0-26de-42cd-b43d-057ec8d61c72" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:51.801848 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-9dcfb745-e680-4dc2-9329-95ba374784be req-b7044bab-1901-46ac-9fb5-1ddd95900bd9 service nova] Acquired lock "refresh_cache-212147b0-26de-42cd-b43d-057ec8d61c72" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:51.801848 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-9dcfb745-e680-4dc2-9329-95ba374784be req-b7044bab-1901-46ac-9fb5-1ddd95900bd9 service nova] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Refreshing network info cache for port 32e8fd61-b6bb-41bf-80b8-c09e23741e03 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:37:51.810772 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:51.918710 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Creating config drive at /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk.config Jun 26 10:37:51.921591 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgipgvcg7 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:51.944668 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:51.969484 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpgipgvcg7" returned: 0 in 0.048s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:37:52.026667 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:52.028204 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:37:52.042629 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Took 8.61 seconds to spawn the instance on the hypervisor. Jun 26 10:37:52.043115 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:52.120675 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Updated VIF entry in instance network info cache for port 2608654f-5761-4d82-a2ab-2a67e20a1c08. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:37:52.120675 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Updating instance_info_cache with network_info: [{"id": "2608654f-5761-4d82-a2ab-2a67e20a1c08", "address": "fa:16:3e:4b:6e:75", "network": {"id": "ee9d6726-90f0-4fdf-978b-d97dc4dc243d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1209858046-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b4242a2b73cf4564ac8f9f2cb9c7a7bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2608654f-57", "ovs_interfaceid": "2608654f-5761-4d82-a2ab-2a67e20a1c08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:52.151154 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lazy-loading 'flavor' on Instance uuid 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:37:52.178022 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:52.248340 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 26 10:37:52.306971 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-9dcfb745-e680-4dc2-9329-95ba374784be req-b7044bab-1901-46ac-9fb5-1ddd95900bd9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:52.339880 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Updating instance_info_cache with network_info: [{"id": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "address": "fa:16:3e:4c:ec:5e", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ae095e-5d", "ovs_interfaceid": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:52.385029 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:52.445402 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:52.471230 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a6f6ed75-8542-42bb-bd6b-5b4e1561b9b2 tempest-VolumesAdminNegativeTest-1830845743 tempest-VolumesAdminNegativeTest-1830845743-project-member] Lock "78222936-8bdc-4928-a30e-924af89fd8b9" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.119s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:52.480122 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:52.483368 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:52.503286 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.513s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:52.530208 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] During sync_power_state the instance has a pending task (spawning). Skip. Jun 26 10:37:52.551725 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Took 14.70 seconds to build instance. Jun 26 10:37:52.582651 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:52.622377 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] Releasing lock "refresh_cache-64a636b4-e106-4968-8740-9938e9b2bcc8" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:52.622377 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Received event network-changed-f3b40b67-c684-437c-83df-5ff22d2249e8 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:52.622377 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Refreshing instance network info cache due to event network-changed-f3b40b67-c684-437c-83df-5ff22d2249e8. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:37:52.622538 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] Acquiring lock "refresh_cache-0b93909a-db10-4b65-b5a7-0aa3f0a47da7" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:52.622655 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] Acquired lock "refresh_cache-0b93909a-db10-4b65-b5a7-0aa3f0a47da7" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:52.622823 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Refreshing network info cache for port f3b40b67-c684-437c-83df-5ff22d2249e8 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:37:52.646400 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:52.655327 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:52.698844 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-9dcfb745-e680-4dc2-9329-95ba374784be req-b7044bab-1901-46ac-9fb5-1ddd95900bd9 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:52.843191 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Releasing lock "refresh_cache-81a0f65d-2017-4275-aabe-88bc8c81225d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:52.843859 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:52.844107 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:52.911232 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-9dcfb745-e680-4dc2-9329-95ba374784be req-b7044bab-1901-46ac-9fb5-1ddd95900bd9 service nova] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Updated VIF entry in instance network info cache for port 32e8fd61-b6bb-41bf-80b8-c09e23741e03. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:37:52.911587 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-9dcfb745-e680-4dc2-9329-95ba374784be req-b7044bab-1901-46ac-9fb5-1ddd95900bd9 service nova] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Updating instance_info_cache with network_info: [{"id": "32e8fd61-b6bb-41bf-80b8-c09e23741e03", "address": "fa:16:3e:90:be:9c", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e8fd61-b6", "ovs_interfaceid": "32e8fd61-b6bb-41bf-80b8-c09e23741e03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:53.052998 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a3711d82-d929-4c6f-b667-5b34b2309f0e tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "047061b2-340c-4cc9-899b-0744dad0081f" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 16.212s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:53.086783 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-ccd4b1fc-980f-4c30-9472-392f759803b2 req-afe66341-6d0f-4fd6-b1b7-9c36b7ae441c service nova] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Received event network-vif-plugged-13baed68-e3c0-4f72-8ccd-0cc2c4cd3552 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:53.087092 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-ccd4b1fc-980f-4c30-9472-392f759803b2 req-afe66341-6d0f-4fd6-b1b7-9c36b7ae441c service nova] Acquiring lock "25b12be8-e92b-4705-b668-05cfecaf66b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:53.087424 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-ccd4b1fc-980f-4c30-9472-392f759803b2 req-afe66341-6d0f-4fd6-b1b7-9c36b7ae441c service nova] Lock "25b12be8-e92b-4705-b668-05cfecaf66b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:53.087688 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-ccd4b1fc-980f-4c30-9472-392f759803b2 req-afe66341-6d0f-4fd6-b1b7-9c36b7ae441c service nova] Lock "25b12be8-e92b-4705-b668-05cfecaf66b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:53.087854 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-ccd4b1fc-980f-4c30-9472-392f759803b2 req-afe66341-6d0f-4fd6-b1b7-9c36b7ae441c service nova] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Processing event network-vif-plugged-13baed68-e3c0-4f72-8ccd-0cc2c4cd3552 {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:37:53.087982 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-ccd4b1fc-980f-4c30-9472-392f759803b2 req-afe66341-6d0f-4fd6-b1b7-9c36b7ae441c service nova] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Received event network-vif-plugged-13baed68-e3c0-4f72-8ccd-0cc2c4cd3552 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:53.088428 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-ccd4b1fc-980f-4c30-9472-392f759803b2 req-afe66341-6d0f-4fd6-b1b7-9c36b7ae441c service nova] Acquiring lock "25b12be8-e92b-4705-b668-05cfecaf66b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:53.088718 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-ccd4b1fc-980f-4c30-9472-392f759803b2 req-afe66341-6d0f-4fd6-b1b7-9c36b7ae441c service nova] Lock "25b12be8-e92b-4705-b668-05cfecaf66b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:53.089426 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-ccd4b1fc-980f-4c30-9472-392f759803b2 req-afe66341-6d0f-4fd6-b1b7-9c36b7ae441c service nova] Lock "25b12be8-e92b-4705-b668-05cfecaf66b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:53.090745 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-ccd4b1fc-980f-4c30-9472-392f759803b2 req-afe66341-6d0f-4fd6-b1b7-9c36b7ae441c service nova] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] No waiting events found dispatching network-vif-plugged-13baed68-e3c0-4f72-8ccd-0cc2c4cd3552 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:37:53.091099 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-ccd4b1fc-980f-4c30-9472-392f759803b2 req-afe66341-6d0f-4fd6-b1b7-9c36b7ae441c service nova] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Received unexpected event network-vif-plugged-13baed68-e3c0-4f72-8ccd-0cc2c4cd3552 for instance with vm_state building and task_state spawning. Jun 26 10:37:53.124993 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:53.157775 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "4b4a4a7e-d584-427e-91d2-7d9e710ea2a3" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.510s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:53.270454 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Found WWN 330000000cedb8bad for multipath device dm-8 {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 26 10:37:53.270454 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.037s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:37:53.270454 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] <== connect_volume: return (3037ms) {'type': 'block', 'scsi_wwn': '330000000cedb8bad', 'path': '/dev/dm-8', 'multipath_id': '330000000cedb8bad'} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:37:53.270454 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cedb8bad', 'path': '/dev/dm-8', 'multipath_id': '330000000cedb8bad'} {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 26 10:37:53.278712 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lazy-loading 'flavor' on Instance uuid c43215aa-be15-4556-8162-bcd9793048c0 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:37:53.389683 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Instance destroyed successfully. Jun 26 10:37:53.390257 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lazy-loading 'resources' on Instance uuid 81a0f65d-2017-4275-aabe-88bc8c81225d {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:37:53.414738 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-9dcfb745-e680-4dc2-9329-95ba374784be req-b7044bab-1901-46ac-9fb5-1ddd95900bd9 service nova] Releasing lock "refresh_cache-212147b0-26de-42cd-b43d-057ec8d61c72" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:53.417527 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:53.417677 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] VM Started (Lifecycle Event) Jun 26 10:37:53.418911 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:37:53.421609 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Guest created on hypervisor {{(pid=98967) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 26 10:37:53.423855 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Instance spawned successfully. Jun 26 10:37:53.424295 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 26 10:37:53.480702 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:53.600964 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:53.601201 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:53.601447 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Attaching volume 243799f9-5b48-488a-9a05-c0ca1141a23b to /dev/vdb Jun 26 10:37:53.646232 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Updated VIF entry in instance network info cache for port f3b40b67-c684-437c-83df-5ff22d2249e8. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:37:53.646540 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Updating instance_info_cache with network_info: [{"id": "f3b40b67-c684-437c-83df-5ff22d2249e8", "address": "fa:16:3e:f2:01:1a", "network": {"id": "ee9d6726-90f0-4fdf-978b-d97dc4dc243d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1209858046-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b4242a2b73cf4564ac8f9f2cb9c7a7bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b40b67-c6", "ovs_interfaceid": "f3b40b67-c684-437c-83df-5ff22d2249e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:53.658787 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.79', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003731', 'execute': None}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:37:53.671149 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.scaleio [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98967) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 10:37:53.695112 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Running cmd (subprocess): nvme version {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:53.725449 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] 'nvme version' failed. Not Retrying. {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 10:37:53.726314 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.nvmeof [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] nvme not present on system {{(pid=98967) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 10:37:53.735384 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98967) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 10:37:53.737711 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.lightos [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Current host hostNQN and IP(s) are ['10.4.3.79', 'fe80::f816:3eff:fe55:ba34', '192.168.40.6', 'fe80::f816:3eff:fe6b:fe1a', '192.168.50.6', 'fe80::f816:3eff:feca:9cd0', '192.168.10.6', 'fe80::f816:3eff:feb4:4e78', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f8bb:38ff:fe28:ff4a', 'fe80::fc16:3eff:fe56:c774', 'fe80::a4ca:b5ff:fe12:2c3c', 'fe80::fc16:3eff:fe37:b3f6', 'fe80::41a:feff:fe02:479d', 'fe80::fc16:3eff:fef2:11a', 'fe80::a061:7eff:feb6:8085', 'fe80::fc16:3eff:fe4b:6e75', 'fe80::fc16:3eff:fe3a:ece4', 'fe80::60f0:e4ff:fe6b:bf4c', 'fe80::fc16:3eff:fe5e:459', 'fe80::fc16:3eff:fe98:a56d', 'fe80::e0a3:7bff:fe72:d1ac', 'fe80::fc16:3eff:fe9b:2a95', 'fe80::fc16:3eff:fe0d:e858', 'fe80::fc16:3eff:fe89:3b98', 'fe80::fc16:3eff:fe4e:45ca', 'fe80::fc16:3eff:fefc:6266', 'fe80::c0fa:55ff:febf:197a', 'fe80::fc16:3eff:fe50:563a', 'fe80::8082:55ff:feee:9f56', 'fe80::fc16:3eff:fe90:be9c', 'fe80::fc16:3eff:fe1b:5509', 'fe80::84cb:23ff:fe8e:e6e6', 'fe80::fc16:3eff:fe5a:811a'] Jun 26 10:37:53.737887 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 10:37:53.738026 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] LIGHTOS: no hostnqn found. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 10:37:53.738980 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] <== get_connector_properties: return (80ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.79', 'host': 'np0000003731', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:2fddcc2116d6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '7f2a0776-2f14-4357-a22e-baa6677eb22e', 'nvme_native_multipath': False} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:37:53.739311 np0000003731 nova-compute[98967]: DEBUG nova.virt.block_device [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Updating existing volume attachment record: f46b29e5-7b45-41af-a00d-855c4221e686 {{(pid=98967) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 26 10:37:53.783857 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] attach device xml: Jun 26 10:37:53.783857 np0000003731 nova-compute[98967]: Jun 26 10:37:53.783857 np0000003731 nova-compute[98967]: Jun 26 10:37:53.783857 np0000003731 nova-compute[98967]: Jun 26 10:37:53.783857 np0000003731 nova-compute[98967]: Jun 26 10:37:53.783857 np0000003731 nova-compute[98967]: 321f2425-a565-4fff-b79c-993dfe4e9d92 Jun 26 10:37:53.783857 np0000003731 nova-compute[98967]:
Jun 26 10:37:53.783857 np0000003731 nova-compute[98967]: Jun 26 10:37:53.783857 np0000003731 nova-compute[98967]: {{(pid=98967) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 26 10:37:53.891288 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-87f5fb79-1907-42f4-bc13-75ed0b40a329 req-5932ffe6-a187-41e5-9451-687efa323692 service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Received event network-changed-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:53.891948 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-87f5fb79-1907-42f4-bc13-75ed0b40a329 req-5932ffe6-a187-41e5-9451-687efa323692 service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Refreshing instance network info cache due to event network-changed-b6ae095e-5da6-45dd-95bd-47cf007120c3. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:37:53.892314 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-87f5fb79-1907-42f4-bc13-75ed0b40a329 req-5932ffe6-a187-41e5-9451-687efa323692 service nova] Acquiring lock "refresh_cache-81a0f65d-2017-4275-aabe-88bc8c81225d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:53.892466 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-87f5fb79-1907-42f4-bc13-75ed0b40a329 req-5932ffe6-a187-41e5-9451-687efa323692 service nova] Acquired lock "refresh_cache-81a0f65d-2017-4275-aabe-88bc8c81225d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:53.893292 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Object Instance<81a0f65d-2017-4275-aabe-88bc8c81225d> lazy-loaded attributes: numa_topology,resources {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:37:53.897419 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-87f5fb79-1907-42f4-bc13-75ed0b40a329 req-5932ffe6-a187-41e5-9451-687efa323692 service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Refreshing network info cache for port b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:37:53.899516 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-674212499',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-attachvolumeshelvetestjson-server-674212499',id=2,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgeE4mXMKcSbJIWHFgR/TXryRGqygdB9I0LofQr9Tkzp2atTItlVxi0dphSY3RtGlhO4PbYXX3eB89/U6r4md80N0ifQ7kIfDklEzYBE4Yx9SRGtqxnbv5XSO42PKS1ng==',key_name='tempest-keypair-313994434',keypairs=,launch_index=0,launched_at=2026-06-26T10:36:59Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=4,progress=0,project_id='39600b204ad64a6db28676693c86dd70',ramdisk_id='',reservation_id='r-691lr44p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-959960600',owner_user_name='tempest-AttachVolumeShelveTestJSON-959960600-project-member',shelved_at='2026-06-26T10:37:50.290933',shelved_host='np0000003731',shelved_image_id='3155480a-a06f-4039-8ee3-f855ef330399'},tags=,task_state='shelving_offloading',terminated_at=None,trusted_certs=,updated_at=2026-06-26T10:37:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a7c139c060e4c998d31cf957835db61',uuid=81a0f65d-2017-4275-aabe-88bc8c81225d,vcpu_model=,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "address": "fa:16:3e:4c:ec:5e", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ae095e-5d", "ovs_interfaceid": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 26 10:37:53.900721 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Converting VIF {"id": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "address": "fa:16:3e:4c:ec:5e", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ae095e-5d", "ovs_interfaceid": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:37:53.900886 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:ec:5e,bridge_name='br-int',has_traffic_filtering=True,id=b6ae095e-5da6-45dd-95bd-47cf007120c3,network=Network(79bcd519-98c3-4905-a83f-c080654f2cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6ae095e-5d') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:37:53.902137 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:ec:5e,bridge_name='br-int',has_traffic_filtering=True,id=b6ae095e-5da6-45dd-95bd-47cf007120c3,network=Network(79bcd519-98c3-4905-a83f-c080654f2cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6ae095e-5d') {{(pid=98967) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 26 10:37:53.905625 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:53.906425 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6ae095e-5d, bridge=br-int, if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:53.910269 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:53.911239 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:53.913890 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:53.914120 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7101acba-caf4-4ad5-aef9-fdaa16fff76e) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:37:53.914716 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:53.915350 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:37:53.916029 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:53.918525 np0000003731 nova-compute[98967]: INFO os_vif [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:ec:5e,bridge_name='br-int',has_traffic_filtering=True,id=b6ae095e-5da6-45dd-95bd-47cf007120c3,network=Network(79bcd519-98c3-4905-a83f-c080654f2cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6ae095e-5d') Jun 26 10:37:53.919174 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Deleting instance files /opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d_del Jun 26 10:37:53.920849 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:53.924235 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:37:53.924904 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Deletion of /opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d_del complete Jun 26 10:37:53.938833 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Found default for hw_cdrom_bus of ide {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:53.939016 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Found default for hw_disk_bus of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:53.939400 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Found default for hw_input_bus of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:53.939653 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Found default for hw_pointer_model of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:53.939910 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Found default for hw_video_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:53.940201 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Found default for hw_vif_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:37:54.152598 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-88a97367-1420-45c6-ae90-7ca44e48a175 req-d79d02ae-8ee3-45ef-bf48-b495a9b27bbd service nova] Releasing lock "refresh_cache-0b93909a-db10-4b65-b5a7-0aa3f0a47da7" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:54.195464 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:54.339672 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Calling os-brick to attach iSCSI Volume {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 26 10:37:54.340144 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b', 'iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '243799f9-5b48-488a-9a05-c0ca1141a23b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:37:54.340387 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:37:54.341289 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:37:54.341289 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b', 'iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '243799f9-5b48-488a-9a05-c0ca1141a23b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 10:37:54.359424 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:37:54.359967 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:37:54.360357 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:37:54.364244 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:37:54.364910 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:37:54.368118 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:37:54.376275 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:37:54.376275 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:54.386753 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:37:54.386753 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:54.393518 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b] added Jun 26 10:37:54.393518 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:37:54.393518 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:37:54.393518 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:37:54.393518 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:37:54.393518 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:37:54.393518 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:54.394026 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:37:54.394026 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0336(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:37:54.394639 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:37:54.401858 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Acquiring lock "5bc6474f-1a05-4e8a-9553-a5597c60728d" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:54.402655 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Lock "5bc6474f-1a05-4e8a-9553-a5597c60728d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:54.405085 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b] added Jun 26 10:37:54.405085 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:37:54.405085 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:37:54.405085 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:37:54.405085 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:37:54.405085 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:37:54.405085 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:54.405422 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:37:54.405836 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0404(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:37:54.405836 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:37:54.408035 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-87f5fb79-1907-42f4-bc13-75ed0b40a329 req-5932ffe6-a187-41e5-9451-687efa323692 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:54.431303 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] During sync_power_state the instance has a pending task (spawning). Skip. Jun 26 10:37:54.437943 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Paused> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:54.438439 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] VM Paused (Lifecycle Event) Jun 26 10:37:54.459538 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Took 8.08 seconds to spawn the instance on the hypervisor. Jun 26 10:37:54.459538 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:54.514337 np0000003731 nova-compute[98967]: INFO nova.scheduler.client.report [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Deleted allocations for instance 81a0f65d-2017-4275-aabe-88bc8c81225d Jun 26 10:37:54.779199 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "4b4a4a7e-d584-427e-91d2-7d9e710ea2a3" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:54.779427 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "4b4a4a7e-d584-427e-91d2-7d9e710ea2a3" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:54.779641 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Attaching volume 47f52d31-fbea-432a-bdb6-e4f813146c47 to /dev/vdb Jun 26 10:37:54.815597 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-87f5fb79-1907-42f4-bc13-75ed0b40a329 req-5932ffe6-a187-41e5-9451-687efa323692 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:54.906113 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Lazy-loading 'flavor' on Instance uuid 5bc6474f-1a05-4e8a-9553-a5597c60728d {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:37:54.951176 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:54.952463 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.79', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003731', 'execute': None}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:37:54.956305 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:54.956305 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] VM Resumed (Lifecycle Event) Jun 26 10:37:54.964588 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.scaleio [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98967) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 10:37:54.970239 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Took 16.17 seconds to build instance. Jun 26 10:37:54.976350 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-87f5fb79-1907-42f4-bc13-75ed0b40a329 req-5932ffe6-a187-41e5-9451-687efa323692 service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Updated VIF entry in instance network info cache for port b6ae095e-5da6-45dd-95bd-47cf007120c3. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:37:54.976617 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-87f5fb79-1907-42f4-bc13-75ed0b40a329 req-5932ffe6-a187-41e5-9451-687efa323692 service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Updating instance_info_cache with network_info: [{"id": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "address": "fa:16:3e:4c:ec:5e", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tapb6ae095e-5d", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:54.991934 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): nvme version {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:55.021673 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] 'nvme version' failed. Not Retrying. {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 10:37:55.021943 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.nvmeof [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] nvme not present on system {{(pid=98967) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 10:37:55.025519 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:55.025800 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:55.030934 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98967) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 10:37:55.032624 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.lightos [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Current host hostNQN and IP(s) are ['10.4.3.79', 'fe80::f816:3eff:fe55:ba34', '192.168.40.6', 'fe80::f816:3eff:fe6b:fe1a', '192.168.50.6', 'fe80::f816:3eff:feca:9cd0', '192.168.10.6', 'fe80::f816:3eff:feb4:4e78', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f8bb:38ff:fe28:ff4a', 'fe80::fc16:3eff:fe56:c774', 'fe80::a4ca:b5ff:fe12:2c3c', 'fe80::fc16:3eff:fe37:b3f6', 'fe80::41a:feff:fe02:479d', 'fe80::fc16:3eff:fef2:11a', 'fe80::a061:7eff:feb6:8085', 'fe80::fc16:3eff:fe4b:6e75', 'fe80::fc16:3eff:fe3a:ece4', 'fe80::60f0:e4ff:fe6b:bf4c', 'fe80::fc16:3eff:fe5e:459', 'fe80::fc16:3eff:fe98:a56d', 'fe80::e0a3:7bff:fe72:d1ac', 'fe80::fc16:3eff:fe9b:2a95', 'fe80::fc16:3eff:fe0d:e858', 'fe80::fc16:3eff:fe89:3b98', 'fe80::fc16:3eff:fe4e:45ca', 'fe80::fc16:3eff:fefc:6266', 'fe80::c0fa:55ff:febf:197a', 'fe80::fc16:3eff:fe50:563a', 'fe80::8082:55ff:feee:9f56', 'fe80::fc16:3eff:fe90:be9c', 'fe80::fc16:3eff:fe1b:5509', 'fe80::84cb:23ff:fe8e:e6e6', 'fe80::fc16:3eff:fe5a:811a'] Jun 26 10:37:55.033363 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 10:37:55.033472 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] LIGHTOS: no hostnqn found. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 10:37:55.033749 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] <== get_connector_properties: return (80ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.79', 'host': 'np0000003731', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:2fddcc2116d6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '7f2a0776-2f14-4357-a22e-baa6677eb22e', 'nvme_native_multipath': False} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:37:55.033965 np0000003731 nova-compute[98967]: DEBUG nova.virt.block_device [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Updating existing volume attachment record: 48aad383-9013-4f1b-bb27-cb59e559a180 {{(pid=98967) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 26 10:37:55.394904 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:37:55.407587 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.40.100 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:37:55.420811 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.50.100 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:37:55.430303 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:55.438540 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:55.457035 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:37:55.457609 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:55.460273 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:55.460273 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:55.460273 np0000003731 nova-compute[98967]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:55.460273 np0000003731 nova-compute[98967]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:55.460273 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:55.460273 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:55.460273 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:55.460273 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:55.460273 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:55.460273 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:55.460273 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:55.460273 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:55.460273 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:55.460273 np0000003731 nova-compute[98967]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:55.460273 np0000003731 nova-compute[98967]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:55.460273 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:55.460273 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:55.460273 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:55.460273 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:55.460273 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:55.460273 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:55.460273 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:55.469186 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:37:55.475533 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:55.475533 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:55.475533 np0000003731 nova-compute[98967]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:55.475533 np0000003731 nova-compute[98967]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:55.475533 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:55.475533 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:55.475533 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:55.475533 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:55.475533 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:55.475533 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:55.475533 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:55.475876 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:55.475876 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:55.475876 np0000003731 nova-compute[98967]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:55.475876 np0000003731 nova-compute[98967]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:55.475876 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:55.475876 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:55.475876 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:55.475876 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:55.475876 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:55.475876 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:55.475876 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:55.480837 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "25b12be8-e92b-4705-b668-05cfecaf66b3" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.689s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:55.481099 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-87f5fb79-1907-42f4-bc13-75ed0b40a329 req-5932ffe6-a187-41e5-9451-687efa323692 service nova] Releasing lock "refresh_cache-81a0f65d-2017-4275-aabe-88bc8c81225d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:55.511395 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] No BDM found with device name sda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:55.511530 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] No BDM found with device name sdb, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:55.512231 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] No BDM found with device name sdc, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:55.515282 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] No VIF found with MAC fa:16:3e:56:c7:74, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:37:55.523212 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b, portal: 192.168.40.100,3260] Jun 26 10:37:55.523212 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b, portal: 192.168.40.100,3260] successful. Jun 26 10:37:55.523212 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:55.529524 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b, portal: 192.168.50.100,3260] Jun 26 10:37:55.529524 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b, portal: 192.168.50.100,3260] successful. Jun 26 10:37:55.529524 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:55.535311 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:55.542917 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:55.555032 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:55.555032 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:55.555032 np0000003731 nova-compute[98967]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:55.555032 np0000003731 nova-compute[98967]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:55.555032 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:37:55.555032 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:37:55.555032 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:55.555032 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:55.555032 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:55.555032 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:55.555032 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:55.555032 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:55.555032 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:55.555032 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:55.555032 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:55.555032 np0000003731 nova-compute[98967]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:55.555032 np0000003731 nova-compute[98967]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:55.555032 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:37:55.555032 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:37:55.555032 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:55.555032 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:55.555032 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:55.555032 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:55.555032 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:55.555032 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:55.555032 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:55.555927 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.195s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:37:55.555927 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Connected to 192.168.40.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:37:55.558026 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] HCTL ('17', '-', '-', 0) found on session 14 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:37:55.558026 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:37:55.580512 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Searching for a device in session 14 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:37:55.583262 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '243799f9-5b48-488a-9a05-c0ca1141a23b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:37:55.585583 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:55.585583 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:55.585583 np0000003731 nova-compute[98967]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:55.585583 np0000003731 nova-compute[98967]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:55.585583 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:37:55.585583 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:37:55.585583 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:55.585583 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:55.585583 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:55.585583 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:55.585583 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:55.585583 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:55.585583 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:55.585831 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:55.585831 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:55.585831 np0000003731 nova-compute[98967]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:55.585831 np0000003731 nova-compute[98967]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:55.585831 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:37:55.585831 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:37:55.585831 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:55.585831 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:55.585831 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:55.585831 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:55.585831 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:55.585831 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:55.585831 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:55.586389 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.221s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:37:55.586389 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Connected to 192.168.50.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:37:55.587704 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] HCTL ('18', '-', '-', 0) found on session 15 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:37:55.587867 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:37:55.601333 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Calling os-brick to attach iSCSI Volume {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 26 10:37:55.602062 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47', 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47f52d31-fbea-432a-bdb6-e4f813146c47', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:37:55.602424 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:37:55.615029 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:37:55.615029 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:37:55.617488 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Searching for a device in session 15 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:37:55.617863 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '243799f9-5b48-488a-9a05-c0ca1141a23b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:37:55.920342 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Lock "5bc6474f-1a05-4e8a-9553-a5597c60728d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.518s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:56.117775 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:37:56.333628 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Rescuing Jun 26 10:37:56.333851 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "refresh_cache-25b12be8-e92b-4705-b668-05cfecaf66b3" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:37:56.334018 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquired lock "refresh_cache-25b12be8-e92b-4705-b668-05cfecaf66b3" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:37:56.334257 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:37:56.370175 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 26 10:37:56.636508 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.610s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:56.837209 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:57.074957 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-79a976da-e348-4684-a559-7056bf096861 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "c43215aa-be15-4556-8162-bcd9793048c0" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.570s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:57.126275 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:57.143850 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-bad46b8f-c2e4-459d-b32b-61476142738f tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d" "released" by "nova.compute.manager.ComputeManager.shelve_instance..do_shelve_instance" :: held 14.794s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:57.245621 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:37:57.384267 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Found WWN 3300000001309e66f for multipath device dm-9 {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 26 10:37:57.384505 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:37:57.384646 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] <== connect_volume: return (3044ms) {'type': 'block', 'scsi_wwn': '3300000001309e66f', 'path': '/dev/dm-9', 'multipath_id': '3300000001309e66f'} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:37:57.384760 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001309e66f', 'path': '/dev/dm-9', 'multipath_id': '3300000001309e66f'} {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 26 10:37:57.385672 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.783s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:37:57.390485 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:57.396457 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47', 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47f52d31-fbea-432a-bdb6-e4f813146c47', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 10:37:57.399146 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lazy-loading 'flavor' on Instance uuid 0b93909a-db10-4b65-b5a7-0aa3f0a47da7 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:37:57.411449 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:37:57.412280 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:37:57.412719 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:37:57.412948 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:37:57.413643 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:37:57.414371 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:37:57.429687 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:37:57.429687 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:57.443472 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Updating instance_info_cache with network_info: [{"id": "13baed68-e3c0-4f72-8ccd-0cc2c4cd3552", "address": "fa:16:3e:5a:81:1a", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13baed68-e3", "ovs_interfaceid": "13baed68-e3c0-4f72-8ccd-0cc2c4cd3552", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:37:57.443472 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:37:57.443472 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:57.446349 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47] added Jun 26 10:37:57.446349 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:37:57.446349 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:37:57.446349 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:37:57.446349 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:37:57.446349 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:37:57.446349 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:57.446752 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:37:57.446945 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0338(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:37:57.446997 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:37:57.454948 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47] added Jun 26 10:37:57.454948 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:37:57.454948 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:37:57.454948 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:37:57.454948 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:37:57.454948 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:37:57.454948 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:57.455258 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:37:57.455337 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0415(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:37:57.455465 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:37:57.567974 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Acquiring lock "5bc6474f-1a05-4e8a-9553-a5597c60728d" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:57.568212 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Lock "5bc6474f-1a05-4e8a-9553-a5597c60728d" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:57.568385 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Attaching volume 018e1ebd-997e-4cdb-833c-31a4add20d1d to /dev/vdb Jun 26 10:37:57.617376 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.79', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003731', 'execute': None}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:37:57.618032 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Acquiring lock "c43215aa-be15-4556-8162-bcd9793048c0" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:57.618244 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "c43215aa-be15-4556-8162-bcd9793048c0" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:57.628743 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.scaleio [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98967) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 10:37:57.650097 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Running cmd (subprocess): nvme version {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:37:57.682482 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] 'nvme version' failed. Not Retrying. {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 10:37:57.682918 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.nvmeof [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] nvme not present on system {{(pid=98967) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 10:37:57.690818 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] LIGHTOS: [Errno 111] Connection refused {{(pid=98967) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 10:37:57.694241 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.lightos [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Current host hostNQN and IP(s) are ['10.4.3.79', 'fe80::f816:3eff:fe55:ba34', '192.168.40.6', 'fe80::f816:3eff:fe6b:fe1a', '192.168.50.6', 'fe80::f816:3eff:feca:9cd0', '192.168.10.6', 'fe80::f816:3eff:feb4:4e78', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f8bb:38ff:fe28:ff4a', 'fe80::fc16:3eff:fe56:c774', 'fe80::a4ca:b5ff:fe12:2c3c', 'fe80::fc16:3eff:fe37:b3f6', 'fe80::41a:feff:fe02:479d', 'fe80::fc16:3eff:fef2:11a', 'fe80::a061:7eff:feb6:8085', 'fe80::fc16:3eff:fe4b:6e75', 'fe80::fc16:3eff:fe3a:ece4', 'fe80::60f0:e4ff:fe6b:bf4c', 'fe80::fc16:3eff:fe5e:459', 'fe80::fc16:3eff:fe98:a56d', 'fe80::e0a3:7bff:fe72:d1ac', 'fe80::fc16:3eff:fe9b:2a95', 'fe80::fc16:3eff:fe0d:e858', 'fe80::fc16:3eff:fe89:3b98', 'fe80::fc16:3eff:fe4e:45ca', 'fe80::fc16:3eff:fefc:6266', 'fe80::c0fa:55ff:febf:197a', 'fe80::fc16:3eff:fe50:563a', 'fe80::8082:55ff:feee:9f56', 'fe80::fc16:3eff:fe90:be9c', 'fe80::fc16:3eff:fe1b:5509', 'fe80::84cb:23ff:fe8e:e6e6', 'fe80::fc16:3eff:fe5a:811a'] Jun 26 10:37:57.694527 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 10:37:57.694610 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] LIGHTOS: no hostnqn found. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 10:37:57.694849 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] <== get_connector_properties: return (77ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.79', 'host': 'np0000003731', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:2fddcc2116d6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '7f2a0776-2f14-4357-a22e-baa6677eb22e', 'nvme_native_multipath': False} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:37:57.695149 np0000003731 nova-compute[98967]: DEBUG nova.virt.block_device [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Updating existing volume attachment record: f32fcc83-c35f-4e40-be25-e4159923f1a0 {{(pid=98967) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 26 10:37:57.902575 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Attempting to attach volume 243799f9-5b48-488a-9a05-c0ca1141a23b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98967) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 26 10:37:57.904367 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] attach device xml: Jun 26 10:37:57.904367 np0000003731 nova-compute[98967]: Jun 26 10:37:57.904367 np0000003731 nova-compute[98967]: Jun 26 10:37:57.904367 np0000003731 nova-compute[98967]: Jun 26 10:37:57.904367 np0000003731 nova-compute[98967]: Jun 26 10:37:57.904367 np0000003731 nova-compute[98967]: 243799f9-5b48-488a-9a05-c0ca1141a23b Jun 26 10:37:57.904367 np0000003731 nova-compute[98967]: Jun 26 10:37:57.904367 np0000003731 nova-compute[98967]: Jun 26 10:37:57.904367 np0000003731 nova-compute[98967]: {{(pid=98967) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 26 10:37:57.944225 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Releasing lock "refresh_cache-25b12be8-e92b-4705-b668-05cfecaf66b3" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:37:58.120800 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Detaching volume 321f2425-a565-4fff-b79c-993dfe4e9d92 Jun 26 10:37:58.174492 np0000003731 nova-compute[98967]: INFO nova.virt.block_device [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Attempting to driver detach volume 321f2425-a565-4fff-b79c-993dfe4e9d92 from mountpoint /dev/sdc Jun 26 10:37:58.181187 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Found disk sdc by alias ua-321f2425-a565-4fff-b79c-993dfe4e9d92 {{(pid=98967) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 26 10:37:58.183756 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Found disk sdc by alias ua-321f2425-a565-4fff-b79c-993dfe4e9d92 {{(pid=98967) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 26 10:37:58.183936 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Attempting to detach device sdc from instance c43215aa-be15-4556-8162-bcd9793048c0 from the persistent domain config. {{(pid=98967) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 26 10:37:58.184270 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] detach device xml: Jun 26 10:37:58.184270 np0000003731 nova-compute[98967]: Jun 26 10:37:58.184270 np0000003731 nova-compute[98967]: Jun 26 10:37:58.184270 np0000003731 nova-compute[98967]: Jun 26 10:37:58.184270 np0000003731 nova-compute[98967]: Jun 26 10:37:58.184270 np0000003731 nova-compute[98967]: 321f2425-a565-4fff-b79c-993dfe4e9d92 Jun 26 10:37:58.184270 np0000003731 nova-compute[98967]:
Jun 26 10:37:58.184270 np0000003731 nova-compute[98967]: Jun 26 10:37:58.184270 np0000003731 nova-compute[98967]: {{(pid=98967) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 26 10:37:58.194650 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Successfully detached device sdc from instance c43215aa-be15-4556-8162-bcd9793048c0 from the persistent domain config. Jun 26 10:37:58.194999 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] (1/8): Attempting to detach device sdc with device alias ua-321f2425-a565-4fff-b79c-993dfe4e9d92 from instance c43215aa-be15-4556-8162-bcd9793048c0 from the live domain config. {{(pid=98967) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 26 10:37:58.195450 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] detach device xml: Jun 26 10:37:58.195450 np0000003731 nova-compute[98967]: Jun 26 10:37:58.195450 np0000003731 nova-compute[98967]: Jun 26 10:37:58.195450 np0000003731 nova-compute[98967]: Jun 26 10:37:58.195450 np0000003731 nova-compute[98967]: Jun 26 10:37:58.195450 np0000003731 nova-compute[98967]: 321f2425-a565-4fff-b79c-993dfe4e9d92 Jun 26 10:37:58.195450 np0000003731 nova-compute[98967]:
Jun 26 10:37:58.195450 np0000003731 nova-compute[98967]: Jun 26 10:37:58.195450 np0000003731 nova-compute[98967]: {{(pid=98967) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 26 10:37:58.275435 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Calling os-brick to attach iSCSI Volume {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 26 10:37:58.275842 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d', 'iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '018e1ebd-997e-4cdb-833c-31a4add20d1d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:37:58.276053 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:37:58.378181 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Received event ua-321f2425-a565-4fff-b79c-993dfe4e9d92> from libvirt while the driver is waiting for it; dispatched. {{(pid=98967) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 26 10:37:58.378593 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Start waiting for the detach event from libvirt for device sdc with device alias ua-321f2425-a565-4fff-b79c-993dfe4e9d92 for instance c43215aa-be15-4556-8162-bcd9793048c0 {{(pid=98967) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 26 10:37:58.382275 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Successfully detached device sdc from instance c43215aa-be15-4556-8162-bcd9793048c0 from the live domain config. Jun 26 10:37:58.382951 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] calling os-brick to detach iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 26 10:37:58.383337 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92', 'iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '321f2425-a565-4fff-b79c-993dfe4e9d92', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:37:58.383476 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:37:58.447548 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:37:58.456236 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.40.100 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:37:58.467063 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.50.100 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:37:58.474716 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:58.482545 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:58.489302 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:58.503142 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:58.503142 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:58.503142 np0000003731 nova-compute[98967]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:58.503142 np0000003731 nova-compute[98967]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:58.503142 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:37:58.503142 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:37:58.503142 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:58.503142 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:58.503142 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:58.503142 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:58.503142 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:58.503142 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:58.503142 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:58.503569 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:58.503569 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:58.503569 np0000003731 nova-compute[98967]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:58.503569 np0000003731 nova-compute[98967]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:58.503569 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:37:58.503569 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:37:58.503569 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:58.503569 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:58.503569 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:58.503569 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:58.503569 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:58.503569 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:58.503569 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:58.511561 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:58.511561 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:58.511561 np0000003731 nova-compute[98967]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:58.511561 np0000003731 nova-compute[98967]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:58.511561 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:37:58.511561 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:37:58.511561 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:58.511561 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:58.511561 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:58.511561 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:58.511561 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:58.511561 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:58.511561 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:58.511561 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:58.511561 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:58.511561 np0000003731 nova-compute[98967]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:58.511561 np0000003731 nova-compute[98967]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:58.511561 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:37:58.511561 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:37:58.511561 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:58.511561 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:58.511561 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:58.511561 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:58.511561 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:58.511561 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:58.511561 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:58.573441 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47, portal: 192.168.40.100,3260] Jun 26 10:37:58.573441 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47, portal: 192.168.40.100,3260] successful. Jun 26 10:37:58.573441 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:58.574945 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47, portal: 192.168.50.100,3260] Jun 26 10:37:58.574945 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47, portal: 192.168.50.100,3260] successful. Jun 26 10:37:58.574945 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:58.589629 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:58.601942 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:37:58.613784 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:58.613784 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:58.613784 np0000003731 nova-compute[98967]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:58.613784 np0000003731 nova-compute[98967]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:58.613784 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:37:58.613784 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:37:58.613784 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:37:58.613784 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:37:58.613784 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:58.613784 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:58.613784 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:58.613784 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:58.613784 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:58.613784 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:58.613784 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:58.614375 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:58.614375 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:58.614375 np0000003731 nova-compute[98967]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:58.614375 np0000003731 nova-compute[98967]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:58.614375 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:37:58.614375 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:37:58.614375 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:37:58.614375 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:37:58.614375 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:58.614375 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:58.614375 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:58.614375 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:58.614375 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:58.614375 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:58.614375 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:58.614375 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.202s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:37:58.614864 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Connected to 192.168.40.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:37:58.616462 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] HCTL ('19', '-', '-', 0) found on session 16 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:37:58.616581 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.210s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:37:58.624052 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Connected to 192.168.50.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:37:58.627119 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] HCTL ('20', '-', '-', 0) found on session 17 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:37:58.627119 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:37:58.635787 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Searching for a device in session 16 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:37:58.636502 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47f52d31-fbea-432a-bdb6-e4f813146c47', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:37:58.643201 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "81a0f65d-2017-4275-aabe-88bc8c81225d" by "nova.compute.manager.ComputeManager.unshelve_instance..do_unshelve_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:58.643201 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d" acquired by "nova.compute.manager.ComputeManager.unshelve_instance..do_unshelve_instance" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:58.643201 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Unshelving Jun 26 10:37:58.645638 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Searching for a device in session 17 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:37:58.645638 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '47f52d31-fbea-432a-bdb6-e4f813146c47', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:37:58.916577 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:59.264046 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:59.413817 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 26 10:37:59.585233 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:59.585393 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:59.585544 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:37:59.585671 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] No VIF found with MAC fa:16:3e:f2:01:1a, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:37:59.589074 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:59.600728 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:59.621664 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:59.767690 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:59.773955 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:59.782450 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-a492c4bc-4fb5-405b-934f-0398701d2b57 req-4dfc0b74-9d8d-43ea-bf6c-a15c1154f6e9 service nova] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Received event network-vif-unplugged-13baed68-e3c0-4f72-8ccd-0cc2c4cd3552 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:37:59.783053 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-a492c4bc-4fb5-405b-934f-0398701d2b57 req-4dfc0b74-9d8d-43ea-bf6c-a15c1154f6e9 service nova] Acquiring lock "25b12be8-e92b-4705-b668-05cfecaf66b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:37:59.783309 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-a492c4bc-4fb5-405b-934f-0398701d2b57 req-4dfc0b74-9d8d-43ea-bf6c-a15c1154f6e9 service nova] Lock "25b12be8-e92b-4705-b668-05cfecaf66b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:37:59.783486 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-a492c4bc-4fb5-405b-934f-0398701d2b57 req-4dfc0b74-9d8d-43ea-bf6c-a15c1154f6e9 service nova] Lock "25b12be8-e92b-4705-b668-05cfecaf66b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:37:59.783668 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-a492c4bc-4fb5-405b-934f-0398701d2b57 req-4dfc0b74-9d8d-43ea-bf6c-a15c1154f6e9 service nova] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] No waiting events found dispatching network-vif-unplugged-13baed68-e3c0-4f72-8ccd-0cc2c4cd3552 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:37:59.783859 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-a492c4bc-4fb5-405b-934f-0398701d2b57 req-4dfc0b74-9d8d-43ea-bf6c-a15c1154f6e9 service nova] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Received unexpected event network-vif-unplugged-13baed68-e3c0-4f72-8ccd-0cc2c4cd3552 for instance with vm_state active and task_state rescuing. Jun 26 10:37:59.802544 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.001240671999994447 future=) submitted to {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:37:59.802544 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Emitting event Stopped> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:37:59.802544 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:37:59.802544 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=2.32624404399985 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:37:59.802544 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=2.326133938999874 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:37:59.802544 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] VM Stopped (Lifecycle Event) Jun 26 10:37:59.888929 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:59.899570 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:37:59.921745 np0000003731 nova-compute[98967]: DEBUG nova.utils [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Queued Task(fn=>, remaining_delay=14.999721744999988 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:37:59.922591 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Instance destroyed successfully. Jun 26 10:37:59.922927 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'numa_topology' on Instance uuid 25b12be8-e92b-4705-b668-05cfecaf66b3 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:00.171501 np0000003731 nova-compute[98967]: INFO nova.virt.block_device [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Booting with volume 686999d0-6896-4156-a01d-0eb60aba41de at /dev/vdc Jun 26 10:38:00.207370 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.79', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003731', 'execute': None}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:38:00.218163 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.scaleio [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98967) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 10:38:00.239173 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): nvme version {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:00.264698 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] 'nvme version' failed. Not Retrying. {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 10:38:00.265159 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.nvmeof [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] nvme not present on system {{(pid=98967) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 10:38:00.272329 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98967) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 10:38:00.274154 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.lightos [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Current host hostNQN and IP(s) are ['10.4.3.79', 'fe80::f816:3eff:fe55:ba34', '192.168.40.6', 'fe80::f816:3eff:fe6b:fe1a', '192.168.50.6', 'fe80::f816:3eff:feca:9cd0', '192.168.10.6', 'fe80::f816:3eff:feb4:4e78', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f8bb:38ff:fe28:ff4a', 'fe80::fc16:3eff:fe56:c774', 'fe80::a4ca:b5ff:fe12:2c3c', 'fe80::fc16:3eff:fe37:b3f6', 'fe80::41a:feff:fe02:479d', 'fe80::fc16:3eff:fef2:11a', 'fe80::a061:7eff:feb6:8085', 'fe80::fc16:3eff:fe4b:6e75', 'fe80::fc16:3eff:fe3a:ece4', 'fe80::60f0:e4ff:fe6b:bf4c', 'fe80::fc16:3eff:fe5e:459', 'fe80::fc16:3eff:fe98:a56d', 'fe80::e0a3:7bff:fe72:d1ac', 'fe80::fc16:3eff:fe9b:2a95', 'fe80::fc16:3eff:fe0d:e858', 'fe80::fc16:3eff:fe89:3b98', 'fe80::fc16:3eff:fe4e:45ca', 'fe80::fc16:3eff:fefc:6266', 'fe80::c0fa:55ff:febf:197a', 'fe80::fc16:3eff:fe50:563a', 'fe80::8082:55ff:feee:9f56', 'fe80::fc16:3eff:fe90:be9c', 'fe80::fc16:3eff:fe1b:5509', 'fe80::84cb:23ff:fe8e:e6e6'] Jun 26 10:38:00.274292 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 10:38:00.274441 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] LIGHTOS: no hostnqn found. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 10:38:00.274698 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] <== get_connector_properties: return (66ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.79', 'host': 'np0000003731', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:2fddcc2116d6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '7f2a0776-2f14-4357-a22e-baa6677eb22e', 'nvme_native_multipath': False} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:38:00.274944 np0000003731 nova-compute[98967]: DEBUG nova.virt.block_device [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Updating existing volume attachment record: 7240d8b5-d112-4fb8-9345-c2f8dc0243c1 {{(pid=98967) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 26 10:38:00.307195 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:00.427981 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Attempting rescue Jun 26 10:38:00.428670 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98967) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4640}} Jun 26 10:38:00.434690 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Instance directory exists: not creating {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}} Jun 26 10:38:00.434690 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Creating image(s) Jun 26 10:38:00.435196 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Found WWN 330000000f0f4940b for multipath device dm-10 {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 26 10:38:00.435738 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.050s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:38:00.436024 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] <== connect_volume: return (4833ms) {'type': 'block', 'scsi_wwn': '330000000f0f4940b', 'path': '/dev/dm-10', 'multipath_id': '330000000f0f4940b'} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:38:00.436185 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f0f4940b', 'path': '/dev/dm-10', 'multipath_id': '330000000f0f4940b'} {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 26 10:38:00.436831 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "/opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:00.437308 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "/opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:00.437878 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.162s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:38:00.438855 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d', 'iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '018e1ebd-997e-4cdb-833c-31a4add20d1d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 10:38:00.439331 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "/opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.002s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:00.439692 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'trusted_certs' on Instance uuid 25b12be8-e92b-4705-b668-05cfecaf66b3 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:00.441209 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lazy-loading 'flavor' on Instance uuid 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:00.454106 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:38:00.454915 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:38:00.456462 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:38:00.456772 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:38:00.458371 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:38:00.458959 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:38:00.469607 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:38:00.469607 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:00.476363 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:38:00.476363 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:00.482696 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d] added Jun 26 10:38:00.482696 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:38:00.482696 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:38:00.482696 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:38:00.482696 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:38:00.482696 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:38:00.482696 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:00.483074 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:38:00.483074 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0263(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:38:00.483154 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:38:00.489281 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d] added Jun 26 10:38:00.489281 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:38:00.489281 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:38:00.489281 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:38:00.489281 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:38:00.489281 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:38:00.489281 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:00.489281 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:38:00.489576 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0309(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:38:00.489736 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:38:00.943460 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Object Instance<25b12be8-e92b-4705-b668-05cfecaf66b3> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:38:00.945183 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Attempting to attach volume 47f52d31-fbea-432a-bdb6-e4f813146c47 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98967) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 26 10:38:00.945536 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:00.949434 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:00.950859 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] attach device xml: Jun 26 10:38:00.950859 np0000003731 nova-compute[98967]: Jun 26 10:38:00.950859 np0000003731 nova-compute[98967]: Jun 26 10:38:00.950859 np0000003731 nova-compute[98967]: Jun 26 10:38:00.950859 np0000003731 nova-compute[98967]: Jun 26 10:38:00.950859 np0000003731 nova-compute[98967]: 47f52d31-fbea-432a-bdb6-e4f813146c47 Jun 26 10:38:00.950859 np0000003731 nova-compute[98967]: Jun 26 10:38:00.950859 np0000003731 nova-compute[98967]: Jun 26 10:38:00.950859 np0000003731 nova-compute[98967]: {{(pid=98967) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 26 10:38:00.957280 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:00.957280 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:00.957280 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:00.957641 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:00.958027 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:01.037053 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.079s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:01.040044 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk.rescue {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:01.084387 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk.rescue" returned: 0 in 0.046s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:01.085030 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.132s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:01.085535 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'migration_context' on Instance uuid 25b12be8-e92b-4705-b668-05cfecaf66b3 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:01.140226 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-896199c4-9f83-4316-af7e-1d4d4a503306 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.538s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:01.173226 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "64a636b4-e106-4968-8740-9938e9b2bcc8" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:01.173226 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "64a636b4-e106-4968-8740-9938e9b2bcc8" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:01.483781 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:38:01.490177 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.40.100 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:38:01.496878 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.50.100 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:38:01.507566 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:01.514246 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:01.523716 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:01.536805 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:01.536805 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:01.536805 np0000003731 nova-compute[98967]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:38:01.536805 np0000003731 nova-compute[98967]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:38:01.536805 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:01.536805 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:01.536805 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:01.536805 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:01.536805 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:01.536805 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:01.536805 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:01.536805 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:01.536805 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:01.536805 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:01.536805 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:38:01.537191 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:01.537191 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:01.537191 np0000003731 nova-compute[98967]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:38:01.537191 np0000003731 nova-compute[98967]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:38:01.537191 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:01.537191 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:01.537191 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:01.537191 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:01.537191 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:01.537191 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:01.537191 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:01.537191 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:01.537191 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:01.537191 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:01.537191 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:38:01.547971 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:01.547971 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:01.547971 np0000003731 nova-compute[98967]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:38:01.547971 np0000003731 nova-compute[98967]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:38:01.547971 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:01.547971 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:01.547971 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:01.547971 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:01.547971 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:01.547971 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:01.547971 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:01.547971 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:01.547971 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:01.547971 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:01.547971 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:38:01.547971 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:01.547971 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:01.547971 np0000003731 nova-compute[98967]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:38:01.547971 np0000003731 nova-compute[98967]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:38:01.547971 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:01.547971 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:01.547971 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:01.547971 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:01.547971 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:01.547971 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:01.547971 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:01.547971 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:01.547971 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:01.547971 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:01.547971 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:38:01.588425 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Object Instance<25b12be8-e92b-4705-b668-05cfecaf66b3> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:38:01.588691 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Created local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 26 10:38:01.589276 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Start _get_guest_xml network_info=[{"id": "13baed68-e3c0-4f72-8ccd-0cc2c4cd3552", "address": "fa:16:3e:5a:81:1a", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "vif_mac": "fa:16:3e:5a:81:1a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13baed68-e3", "ovs_interfaceid": "13baed68-e3c0-4f72-8ccd-0cc2c4cd3552", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=) rescue={'image_id': 'a9b18127-6fee-4ed6-b364-a2d634ecb8b7', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:38:01.589899 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'resources' on Instance uuid 25b12be8-e92b-4705-b668-05cfecaf66b3 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:01.598310 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d, portal: 192.168.40.100,3260] Jun 26 10:38:01.598310 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d, portal: 192.168.40.100,3260] successful. Jun 26 10:38:01.598310 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:01.609738 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d, portal: 192.168.50.100,3260] Jun 26 10:38:01.609738 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d, portal: 192.168.50.100,3260] successful. Jun 26 10:38:01.609738 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:01.616193 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:01.623931 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:01.646539 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:01.646539 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:01.646539 np0000003731 nova-compute[98967]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:38:01.646539 np0000003731 nova-compute[98967]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:38:01.646539 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:01.646539 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:01.646539 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:01.646539 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:01.646539 np0000003731 nova-compute[98967]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:01.646539 np0000003731 nova-compute[98967]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:01.646539 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:01.646539 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:01.646539 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:01.646539 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:01.646539 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:01.646539 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:01.646539 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:38:01.647197 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:01.647197 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:01.647197 np0000003731 nova-compute[98967]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:38:01.647197 np0000003731 nova-compute[98967]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:38:01.647197 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:01.647197 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:01.647197 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:01.647197 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:01.647197 np0000003731 nova-compute[98967]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:01.647197 np0000003731 nova-compute[98967]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:01.647197 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:01.647197 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:01.647197 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:01.647197 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:01.647197 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:01.647197 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:01.647197 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:38:01.648426 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.190s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:38:01.648535 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Connected to 192.168.50.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:38:01.648716 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:01.648716 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:01.648716 np0000003731 nova-compute[98967]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:38:01.648716 np0000003731 nova-compute[98967]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:38:01.648716 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:01.648716 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:01.648716 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:01.648716 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:01.648716 np0000003731 nova-compute[98967]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:01.648716 np0000003731 nova-compute[98967]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:01.648716 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:01.648716 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:01.648716 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:01.648716 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:01.648716 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:01.648716 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:01.648716 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:38:01.649240 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:01.649240 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:01.649240 np0000003731 nova-compute[98967]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:38:01.649240 np0000003731 nova-compute[98967]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:38:01.649240 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:01.649240 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:01.649240 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:01.649240 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:01.649240 np0000003731 nova-compute[98967]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:01.649240 np0000003731 nova-compute[98967]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:01.649240 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:01.649240 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:01.649240 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:01.649240 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:01.649240 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:01.649240 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:01.649240 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:38:01.649240 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.193s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:38:01.649240 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Connected to 192.168.40.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:38:01.651476 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] HCTL ('22', '-', '-', 0) found on session 19 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:38:01.651579 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Scanning host 22 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:38:01.651954 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] HCTL ('21', '-', '-', 0) found on session 18 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:38:01.652080 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Scanning host 21 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:38:01.670810 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Searching for a device in session 19 and hctl ['22', '*', '*', 0] yield: None {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:38:01.678221 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Searching for a device in session 18 and hctl ['21', '*', '*', 0] yield: sdq {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:38:01.678221 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '018e1ebd-997e-4cdb-833c-31a4add20d1d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:38:01.682860 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lazy-loading 'flavor' on Instance uuid 64a636b4-e106-4968-8740-9938e9b2bcc8 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:01.867564 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-faec38e3-4520-40e8-9b28-22987a65e64a req-3c5b5bac-db2b-4d19-8043-873bdd290fc9 service nova] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Received event network-vif-unplugged-13baed68-e3c0-4f72-8ccd-0cc2c4cd3552 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:01.869162 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-faec38e3-4520-40e8-9b28-22987a65e64a req-3c5b5bac-db2b-4d19-8043-873bdd290fc9 service nova] Acquiring lock "25b12be8-e92b-4705-b668-05cfecaf66b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:01.869162 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-faec38e3-4520-40e8-9b28-22987a65e64a req-3c5b5bac-db2b-4d19-8043-873bdd290fc9 service nova] Lock "25b12be8-e92b-4705-b668-05cfecaf66b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:01.869162 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-faec38e3-4520-40e8-9b28-22987a65e64a req-3c5b5bac-db2b-4d19-8043-873bdd290fc9 service nova] Lock "25b12be8-e92b-4705-b668-05cfecaf66b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:01.869162 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-faec38e3-4520-40e8-9b28-22987a65e64a req-3c5b5bac-db2b-4d19-8043-873bdd290fc9 service nova] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] No waiting events found dispatching network-vif-unplugged-13baed68-e3c0-4f72-8ccd-0cc2c4cd3552 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:01.869162 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-faec38e3-4520-40e8-9b28-22987a65e64a req-3c5b5bac-db2b-4d19-8043-873bdd290fc9 service nova] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Received unexpected event network-vif-unplugged-13baed68-e3c0-4f72-8ccd-0cc2c4cd3552 for instance with vm_state active and task_state rescuing. Jun 26 10:38:01.955816 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:01.955971 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:01.957002 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lazy-loading 'pci_requests' on Instance uuid 81a0f65d-2017-4275-aabe-88bc8c81225d {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:02.091357 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Object Instance<25b12be8-e92b-4705-b668-05cfecaf66b3> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:38:02.092975 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:38:02.094270 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-1611932593', uuid='25b12be8-e92b-4705-b668-05cfecaf66b3'), owner=OwnerMeta(userid='04176251e13046eb8cfc1908246d4d9d', username='tempest-ServerRescueNegativeTestJSON-1439990304-project-member', projectid='58a58b94e5ec406182da9117e14aa789', projectname='tempest-ServerRescueNegativeTestJSON-1439990304'), image=ImageMeta(id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "13baed68-e3c0-4f72-8ccd-0cc2c4cd3552", "address": "fa:16:3e:5a:81:1a", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "vif_mac": "fa:16:3e:5a:81:1a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13baed68-e3", "ovs_interfaceid": "13baed68-e3c0-4f72-8ccd-0cc2c4cd3552", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470282.0938451) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:38:02.096128 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:38:02.096493 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:38:02.097160 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:38:02.097333 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:38:02.098329 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:38:02.098643 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:38:02.098814 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:38:02.098855 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:38:02.098951 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:38:02.099068 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:38:02.099170 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:38:02.099327 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:38:02.099402 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:38:02.099527 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:38:02.099620 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:38:02.099746 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:38:02.099878 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'vcpu_model' on Instance uuid 25b12be8-e92b-4705-b668-05cfecaf66b3 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:02.127175 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004753770001570956 future=) submitted to {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:02.128523 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Emitting event Stopped> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:38:02.128700 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:02.128924 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] VM Stopped (Lifecycle Event) Jun 26 10:38:02.129885 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=12.791556154999853 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:02.130196 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=12.791238816999794 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:02.387939 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:02.460236 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lazy-loading 'numa_topology' on Instance uuid 81a0f65d-2017-4275-aabe-88bc8c81225d {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:02.601845 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Object Instance<25b12be8-e92b-4705-b668-05cfecaf66b3> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:38:02.612697 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:37:37Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-1611932593',display_name='tempest-ServerRescueNegativeTestJSON-server-1611932593',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-serverrescuenegativetestjson-server-1611932593',id=13,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-26T10:37:54Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='58a58b94e5ec406182da9117e14aa789',ramdisk_id='',reservation_id='r-0hfv2xzq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1439990304',owner_user_name='tempest-ServerRescueNegativeTestJSON-1439990304-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:55Z,user_data=None,user_id='04176251e13046eb8cfc1908246d4d9d',uuid=25b12be8-e92b-4705-b668-05cfecaf66b3,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "13baed68-e3c0-4f72-8ccd-0cc2c4cd3552", "address": "fa:16:3e:5a:81:1a", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "vif_mac": "fa:16:3e:5a:81:1a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13baed68-e3", "ovs_interfaceid": "13baed68-e3c0-4f72-8ccd-0cc2c4cd3552", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:38:02.612916 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Converting VIF {"id": "13baed68-e3c0-4f72-8ccd-0cc2c4cd3552", "address": "fa:16:3e:5a:81:1a", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "vif_mac": "fa:16:3e:5a:81:1a"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap13baed68-e3", "ovs_interfaceid": "13baed68-e3c0-4f72-8ccd-0cc2c4cd3552", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:38:02.613517 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:5a:81:1a,bridge_name='br-int',has_traffic_filtering=True,id=13baed68-e3c0-4f72-8ccd-0cc2c4cd3552,network=Network(d50baa85-72ef-4bb3-9676-e629d583d3a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap13baed68-e3') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:38:02.614080 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'pci_devices' on Instance uuid 25b12be8-e92b-4705-b668-05cfecaf66b3 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:02.632201 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 78222936-8bdc-4928-a30e-924af89fd8b9] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:02.643515 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:38:02.643515 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:38:02.643515 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:38:02.643515 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No VIF found with MAC fa:16:3e:5e:04:59, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:38:02.670901 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Searching for a device in session 19 and hctl ['22', '*', '*', 0] yield: sdp {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:38:02.671078 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '018e1ebd-997e-4cdb-833c-31a4add20d1d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:38:02.688692 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "64a636b4-e106-4968-8740-9938e9b2bcc8" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.516s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:02.962645 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98967) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 26 10:38:02.962811 np0000003731 nova-compute[98967]: INFO nova.compute.claims [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Claim successful on node np0000003731 Jun 26 10:38:03.117549 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Object Instance<25b12be8-e92b-4705-b668-05cfecaf66b3> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] End _get_guest_xml xml= Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: 25b12be8-e92b-4705-b668-05cfecaf66b3 Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: instance-0000000d Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: 196608 Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: tempest-ServerRescueNegativeTestJSON-server-1611932593 Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: 2026-06-26 10:38:02 Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: 192 Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: 0 Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: 0 Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: True Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: bare Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: 0 Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: ide Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: virtio Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: pc Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: virtio Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: virtio Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: virtio Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: tempest-ServerRescueNegativeTestJSON-1439990304-project-member Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: tempest-ServerRescueNegativeTestJSON-1439990304 Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: 25b12be8-e92b-4705-b668-05cfecaf66b3 Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: 25b12be8-e92b-4705-b668-05cfecaf66b3 Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: hvm Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: 128 Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: Jun 26 10:38:03.118577 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:38:03.124251 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Instance destroyed successfully. Jun 26 10:38:03.479663 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Found WWN 3300000007f711b96 for multipath device dm-11 {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 26 10:38:03.479663 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:38:03.479663 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] <== connect_volume: return (5203ms) {'type': 'block', 'scsi_wwn': '3300000007f711b96', 'path': '/dev/dm-11', 'multipath_id': '3300000007f711b96'} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:38:03.479663 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000007f711b96', 'path': '/dev/dm-11', 'multipath_id': '3300000007f711b96'} {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 26 10:38:03.480481 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 5.097s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:38:03.481122 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92', 'iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '321f2425-a565-4fff-b79c-993dfe4e9d92', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 10:38:03.481331 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92', 0)] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 10:38:03.482974 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Lazy-loading 'flavor' on Instance uuid 5bc6474f-1a05-4e8a-9553-a5597c60728d {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:03.519530 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:03.519530 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:03.519530 np0000003731 nova-compute[98967]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:38:03.519530 np0000003731 nova-compute[98967]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:38:03.519530 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:03.519530 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:03.519530 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:03.519530 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:03.519530 np0000003731 nova-compute[98967]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:03.519530 np0000003731 nova-compute[98967]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:03.519530 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:03.519530 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:03.519530 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:03.519530 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:03.519530 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:03.519530 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:03.519530 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:38:03.520039 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:03.520039 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:03.520039 np0000003731 nova-compute[98967]: tcp: [12] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:38:03.520039 np0000003731 nova-compute[98967]: tcp: [13] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92 (non-flash) Jun 26 10:38:03.520039 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:03.520039 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:03.520039 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:03.520039 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:03.520039 np0000003731 nova-compute[98967]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:03.520039 np0000003731 nova-compute[98967]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:03.520039 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:03.520039 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:03.520039 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:03.520039 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:03.520039 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:03.520039 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:03.520039 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:38:03.520039 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92', '12'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92', '13'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b', '15'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47', '16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020', '7'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77', '9')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 10:38:03.520039 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92', '12')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:38:03.521036 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92', '13')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:38:03.522086 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Resulting device map defaultdict(. at 0x75f0704240e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92'): ({'sdk'}, set())}) {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 10:38:03.522289 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Removing multipathed devices sdj, sdk {{(pid=98967) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 10:38:03.523060 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Flush multipath device 330000000cedb8bad {{(pid=98967) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 26 10:38:03.556855 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:38:03.607593 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:38:03.668414 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 10:38:03.668567 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 10:38:03.669997 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 10:38:03.680598 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 10:38:03.680785 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92')] {{(pid=98967) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 10:38:03.693692 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:03.737360 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 12, target: iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92, portal: 192.168.40.100,3260] Jun 26 10:38:03.737360 np0000003731 nova-compute[98967]: Logout of [sid: 12, target: iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92, portal: 192.168.40.100,3260] successful. Jun 26 10:38:03.737360 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:03.765943 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:03.778942 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "64a636b4-e106-4968-8740-9938e9b2bcc8" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:03.779705 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:03.782659 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "64a636b4-e106-4968-8740-9938e9b2bcc8" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:03.782659 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Attaching volume 243799f9-5b48-488a-9a05-c0ca1141a23b to /dev/vdb Jun 26 10:38:03.819915 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 13, target: iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92, portal: 192.168.50.100,3260] Jun 26 10:38:03.819915 np0000003731 nova-compute[98967]: Logout of [sid: 13, target: iqn.2023-03.storpool.com:os--volume-321f2425-a565-4fff-b79c-993dfe4e9d92, portal: 192.168.50.100,3260] successful. Jun 26 10:38:03.819915 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:03.826121 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.79', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003731', 'execute': None}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:38:03.843471 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.scaleio [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98967) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 10:38:03.844084 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:03.844369 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:38:03.844540 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] <== disconnect_volume: return (5460ms) None {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:38:03.844708 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Disconnected iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 26 10:38:03.873036 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Running cmd (subprocess): nvme version {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:03.896295 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] 'nvme version' failed. Not Retrying. {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 10:38:03.897439 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.nvmeof [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] nvme not present on system {{(pid=98967) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 10:38:03.908034 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98967) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 10:38:03.909952 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.lightos [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Current host hostNQN and IP(s) are ['10.4.3.79', 'fe80::f816:3eff:fe55:ba34', '192.168.40.6', 'fe80::f816:3eff:fe6b:fe1a', '192.168.50.6', 'fe80::f816:3eff:feca:9cd0', '192.168.10.6', 'fe80::f816:3eff:feb4:4e78', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f8bb:38ff:fe28:ff4a', 'fe80::fc16:3eff:fe56:c774', 'fe80::a4ca:b5ff:fe12:2c3c', 'fe80::fc16:3eff:fe37:b3f6', 'fe80::41a:feff:fe02:479d', 'fe80::fc16:3eff:fef2:11a', 'fe80::a061:7eff:feb6:8085', 'fe80::fc16:3eff:fe4b:6e75', 'fe80::fc16:3eff:fe3a:ece4', 'fe80::60f0:e4ff:fe6b:bf4c', 'fe80::fc16:3eff:fe5e:459', 'fe80::fc16:3eff:fe98:a56d', 'fe80::e0a3:7bff:fe72:d1ac', 'fe80::fc16:3eff:fe9b:2a95', 'fe80::fc16:3eff:fe0d:e858', 'fe80::fc16:3eff:fe89:3b98', 'fe80::fc16:3eff:fe4e:45ca', 'fe80::fc16:3eff:fefc:6266', 'fe80::c0fa:55ff:febf:197a', 'fe80::fc16:3eff:fe50:563a', 'fe80::8082:55ff:feee:9f56', 'fe80::fc16:3eff:fe90:be9c', 'fe80::fc16:3eff:fe1b:5509', 'fe80::84cb:23ff:fe8e:e6e6'] Jun 26 10:38:03.910366 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 10:38:03.910606 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] LIGHTOS: no hostnqn found. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 10:38:03.910998 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] <== get_connector_properties: return (84ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.79', 'host': 'np0000003731', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:2fddcc2116d6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '7f2a0776-2f14-4357-a22e-baa6677eb22e', 'nvme_native_multipath': False} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:38:03.911482 np0000003731 nova-compute[98967]: DEBUG nova.virt.block_device [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Updating existing volume attachment record: a8cf063e-96bd-4e69-a22e-497783eef963 {{(pid=98967) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 26 10:38:03.919586 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:03.987380 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Attempting to attach volume 018e1ebd-997e-4cdb-833c-31a4add20d1d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98967) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 26 10:38:03.989676 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] attach device xml: Jun 26 10:38:03.989676 np0000003731 nova-compute[98967]: Jun 26 10:38:03.989676 np0000003731 nova-compute[98967]: Jun 26 10:38:03.989676 np0000003731 nova-compute[98967]: Jun 26 10:38:03.989676 np0000003731 nova-compute[98967]: Jun 26 10:38:03.989676 np0000003731 nova-compute[98967]: 018e1ebd-997e-4cdb-833c-31a4add20d1d Jun 26 10:38:03.989676 np0000003731 nova-compute[98967]: Jun 26 10:38:03.989676 np0000003731 nova-compute[98967]: {{(pid=98967) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 26 10:38:04.212583 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2348b32a-c5dc-4959-b022-9ab287f89f16 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "4b4a4a7e-d584-427e-91d2-7d9e710ea2a3" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 9.433s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:04.340078 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "212147b0-26de-42cd-b43d-057ec8d61c72" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:04.340820 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "212147b0-26de-42cd-b43d-057ec8d61c72" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:04.425726 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lazy-loading 'flavor' on Instance uuid c43215aa-be15-4556-8162-bcd9793048c0 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:04.477530 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Calling os-brick to attach iSCSI Volume {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 26 10:38:04.477827 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b', 'iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '243799f9-5b48-488a-9a05-c0ca1141a23b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:38:04.477999 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:38:04.478385 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:38:04.478605 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b', 'iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '243799f9-5b48-488a-9a05-c0ca1141a23b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 10:38:04.490859 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:38:04.491442 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:38:04.492048 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:38:04.492278 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:38:04.492483 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:38:04.492655 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.startup = automatic Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.session.scan = manual Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.50.100 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:38:04.509000 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.startup = automatic Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.session.scan = manual Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.40.100 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:38:04.515224 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:04.527782 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:04.533755 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:04.551291 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:04.551291 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:04.551291 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:04.551291 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:04.551291 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:04.551291 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:04.551291 np0000003731 nova-compute[98967]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:04.551291 np0000003731 nova-compute[98967]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:04.551291 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:04.551291 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:04.551291 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:04.551291 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:04.551291 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:04.551291 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:04.551291 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:38:04.551724 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:04.551724 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:04.551724 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:04.551724 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:04.551724 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:04.551724 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:04.551724 np0000003731 nova-compute[98967]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:04.551724 np0000003731 nova-compute[98967]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:04.551724 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:04.551724 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:04.551724 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:04.551724 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:04.551724 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:04.551724 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:04.551724 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:38:04.552076 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.059s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:38:04.552076 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Connected to 192.168.50.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:38:04.553134 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] HCTL ('18', '0', '0', 0) found on session 15 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:38:04.553274 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Scanning host 18 c: 0, t: 0, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:38:04.562392 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:04.562392 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:04.562392 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:04.562392 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:04.562392 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:04.562392 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:04.562392 np0000003731 nova-compute[98967]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:04.562392 np0000003731 nova-compute[98967]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:04.562392 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:04.562392 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:04.562392 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:04.562392 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:04.562392 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:04.562392 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:04.562392 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:38:04.562944 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:04.562944 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:04.562944 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:04.562944 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:04.562944 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:04.562944 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:04.562944 np0000003731 nova-compute[98967]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:04.562944 np0000003731 nova-compute[98967]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:04.562944 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:04.562944 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:04.562944 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:04.562944 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:04.562944 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:04.562944 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:04.562944 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:38:04.563530 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.071s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:38:04.563530 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Connected to 192.168.40.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:38:04.564664 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Searching for a device in session 15 and hctl ('18', '0', '0', 0) yield: sdm {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:38:04.564833 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '243799f9-5b48-488a-9a05-c0ca1141a23b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:38:04.565763 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] HCTL ('17', '0', '0', 0) found on session 14 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:38:04.565938 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Scanning host 17 c: 0, t: 0, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:38:04.573886 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Searching for a device in session 14 and hctl ('17', '0', '0', 0) yield: sdl {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:38:04.574078 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '243799f9-5b48-488a-9a05-c0ca1141a23b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:38:04.608727 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:38:04.609164 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:38:04.652604 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:38:04.652761 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:38:04.652856 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:38:04.652974 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] No VIF found with MAC fa:16:3e:5a:81:1a, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:38:04.653510 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Using config drive Jun 26 10:38:04.844436 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lazy-loading 'flavor' on Instance uuid 212147b0-26de-42cd-b43d-057ec8d61c72 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:05.111472 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:38:05.156422 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'ec2_ids' on Instance uuid 25b12be8-e92b-4705-b668-05cfecaf66b3 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:05.431257 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-78f884a0-fbb2-4c2c-adb6-c8cf1567e35d tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "c43215aa-be15-4556-8162-bcd9793048c0" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 7.813s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:05.493476 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 26 10:38:05.618367 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.662s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:05.618763 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:05.644499 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:38:05.644658 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] No BDM found with device name vdb, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:38:05.644779 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:38:05.644877 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] No VIF found with MAC fa:16:3e:3a:ec:e4, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:38:05.660752 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Object Instance<25b12be8-e92b-4705-b668-05cfecaf66b3> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:38:05.660906 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'keypairs' on Instance uuid 25b12be8-e92b-4705-b668-05cfecaf66b3 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:05.751998 np0000003731 nova-compute[98967]: INFO nova.network.neutron [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Updating port b6ae095e-5da6-45dd-95bd-47cf007120c3 with attributes {'binding:host_id': 'np0000003731', 'device_owner': 'compute:nova'} Jun 26 10:38:05.849848 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "212147b0-26de-42cd-b43d-057ec8d61c72" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.509s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:06.164265 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Object Instance<25b12be8-e92b-4705-b668-05cfecaf66b3> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:38:06.166939 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:06.191330 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:06.349379 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Creating config drive at /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk.config.rescue Jun 26 10:38:06.352823 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpiz316drs {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:06.371809 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c850b564-0a93-4ada-994c-8e6802855783 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Acquiring lock "c43215aa-be15-4556-8162-bcd9793048c0" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:06.378113 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c850b564-0a93-4ada-994c-8e6802855783 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "c43215aa-be15-4556-8162-bcd9793048c0" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:06.378113 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c850b564-0a93-4ada-994c-8e6802855783 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Acquiring lock "c43215aa-be15-4556-8162-bcd9793048c0-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:06.378113 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c850b564-0a93-4ada-994c-8e6802855783 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "c43215aa-be15-4556-8162-bcd9793048c0-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:06.378113 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c850b564-0a93-4ada-994c-8e6802855783 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "c43215aa-be15-4556-8162-bcd9793048c0-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:06.378113 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-c850b564-0a93-4ada-994c-8e6802855783 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Terminating instance Jun 26 10:38:06.392194 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpiz316drs" returned: 0 in 0.039s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:06.507577 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Found WWN 3300000001309e66f for multipath device dm-9 {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 26 10:38:06.508114 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.030s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:38:06.508371 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] <== connect_volume: return (2030ms) {'type': 'block', 'scsi_wwn': '3300000001309e66f', 'path': '/dev/dm-9', 'multipath_id': '3300000001309e66f'} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:38:06.508549 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000001309e66f', 'path': '/dev/dm-9', 'multipath_id': '3300000001309e66f'} {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 26 10:38:06.526376 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lazy-loading 'flavor' on Instance uuid 64a636b4-e106-4968-8740-9938e9b2bcc8 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:06.800713 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "refresh_cache-81a0f65d-2017-4275-aabe-88bc8c81225d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:38:06.801456 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquired lock "refresh_cache-81a0f65d-2017-4275-aabe-88bc8c81225d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:38:06.801762 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:38:06.891896 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-c850b564-0a93-4ada-994c-8e6802855783 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Start destroying the instance on the hypervisor. {{(pid=98967) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 26 10:38:06.892557 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:06.915661 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-523d7c9e-5da2-4b4e-bb5e-d43690eb3149 req-3a88a529-8e13-432f-8a91-62782612acce service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Received event network-changed-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:06.915661 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-523d7c9e-5da2-4b4e-bb5e-d43690eb3149 req-3a88a529-8e13-432f-8a91-62782612acce service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Refreshing instance network info cache due to event network-changed-b6ae095e-5da6-45dd-95bd-47cf007120c3. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:38:06.915661 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-523d7c9e-5da2-4b4e-bb5e-d43690eb3149 req-3a88a529-8e13-432f-8a91-62782612acce service nova] Acquiring lock "refresh_cache-81a0f65d-2017-4275-aabe-88bc8c81225d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:38:06.931666 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:06.942825 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:06.942825 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:06.961622 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:07.024120 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:07.030125 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Attempting to attach volume 243799f9-5b48-488a-9a05-c0ca1141a23b with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98967) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 26 10:38:07.038390 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] attach device xml: Jun 26 10:38:07.038390 np0000003731 nova-compute[98967]: Jun 26 10:38:07.038390 np0000003731 nova-compute[98967]: Jun 26 10:38:07.038390 np0000003731 nova-compute[98967]: Jun 26 10:38:07.038390 np0000003731 nova-compute[98967]: Jun 26 10:38:07.038390 np0000003731 nova-compute[98967]: 243799f9-5b48-488a-9a05-c0ca1141a23b Jun 26 10:38:07.038390 np0000003731 nova-compute[98967]: Jun 26 10:38:07.038390 np0000003731 nova-compute[98967]: Jun 26 10:38:07.038390 np0000003731 nova-compute[98967]: {{(pid=98967) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 26 10:38:07.115605 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:07.125313 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:07.145372 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:07.174142 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:07.175431 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:07.211418 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-fb1116bc-6ea1-4fef-a422-446cb543edde req-3ca26765-c6ed-4c37-8389-4c95dd402e66 service nova] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Received event network-vif-unplugged-85e3464e-eadb-4a6d-b3b5-073945346160 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:07.211686 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-fb1116bc-6ea1-4fef-a422-446cb543edde req-3ca26765-c6ed-4c37-8389-4c95dd402e66 service nova] Acquiring lock "c43215aa-be15-4556-8162-bcd9793048c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:07.211912 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-fb1116bc-6ea1-4fef-a422-446cb543edde req-3ca26765-c6ed-4c37-8389-4c95dd402e66 service nova] Lock "c43215aa-be15-4556-8162-bcd9793048c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:07.212136 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-fb1116bc-6ea1-4fef-a422-446cb543edde req-3ca26765-c6ed-4c37-8389-4c95dd402e66 service nova] Lock "c43215aa-be15-4556-8162-bcd9793048c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:07.212306 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-fb1116bc-6ea1-4fef-a422-446cb543edde req-3ca26765-c6ed-4c37-8389-4c95dd402e66 service nova] [instance: c43215aa-be15-4556-8162-bcd9793048c0] No waiting events found dispatching network-vif-unplugged-85e3464e-eadb-4a6d-b3b5-073945346160 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:07.212752 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-fb1116bc-6ea1-4fef-a422-446cb543edde req-3ca26765-c6ed-4c37-8389-4c95dd402e66 service nova] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Received event network-vif-unplugged-85e3464e-eadb-4a6d-b3b5-073945346160 for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:38:07.283935 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "212147b0-26de-42cd-b43d-057ec8d61c72" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:07.291990 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "212147b0-26de-42cd-b43d-057ec8d61c72" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:07.291990 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Attaching volume 47f52d31-fbea-432a-bdb6-e4f813146c47 to /dev/vdb Jun 26 10:38:07.291990 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-821f8b11-f8b2-492e-9836-2d84ee7efcaf tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Lock "5bc6474f-1a05-4e8a-9553-a5597c60728d" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 9.720s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:07.304319 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:07.347453 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:07.358450 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:07.396827 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:07.397858 np0000003731 nova-compute[98967]: DEBUG nova.utils [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Queued Task(fn=>, remaining_delay=14.999653868999985 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:07.408349 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Instance destroyed successfully. Jun 26 10:38:07.409704 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-c850b564-0a93-4ada-994c-8e6802855783 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lazy-loading 'resources' on Instance uuid c43215aa-be15-4556-8162-bcd9793048c0 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:07.414311 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.79', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003731', 'execute': None}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:38:07.421759 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0a02ad7e-77ff-4d2a-a792-1136aeab5419 tempest-VolumesAssistedSnapshotsTest-1388171202 tempest-VolumesAssistedSnapshotsTest-1388171202-project] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] volume_snapshot_create: create_info: {'snapshot_id': '762846f0-43d4-4edc-ba34-33bfad369855', 'type': 'qcow2', 'new_file': 'new_file'} {{(pid=98967) volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3759}} Jun 26 10:38:07.426707 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-2c9593ab-420f-45bc-8d61-290337f4d8b9 req-687376a1-a679-4961-bfaf-589cfc995487 service nova] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Received event network-vif-plugged-13baed68-e3c0-4f72-8ccd-0cc2c4cd3552 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:07.433060 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-2c9593ab-420f-45bc-8d61-290337f4d8b9 req-687376a1-a679-4961-bfaf-589cfc995487 service nova] Acquiring lock "25b12be8-e92b-4705-b668-05cfecaf66b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:07.433060 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-2c9593ab-420f-45bc-8d61-290337f4d8b9 req-687376a1-a679-4961-bfaf-589cfc995487 service nova] Lock "25b12be8-e92b-4705-b668-05cfecaf66b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:07.433060 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-2c9593ab-420f-45bc-8d61-290337f4d8b9 req-687376a1-a679-4961-bfaf-589cfc995487 service nova] Lock "25b12be8-e92b-4705-b668-05cfecaf66b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:07.433060 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-2c9593ab-420f-45bc-8d61-290337f4d8b9 req-687376a1-a679-4961-bfaf-589cfc995487 service nova] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] No waiting events found dispatching network-vif-plugged-13baed68-e3c0-4f72-8ccd-0cc2c4cd3552 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:07.433060 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-2c9593ab-420f-45bc-8d61-290337f4d8b9 req-687376a1-a679-4961-bfaf-589cfc995487 service nova] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Received unexpected event network-vif-plugged-13baed68-e3c0-4f72-8ccd-0cc2c4cd3552 for instance with vm_state active and task_state rescuing. Jun 26 10:38:07.440607 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.scaleio [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98967) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 10:38:07.447851 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0a02ad7e-77ff-4d2a-a792-1136aeab5419 tempest-VolumesAssistedSnapshotsTest-1388171202 tempest-VolumesAssistedSnapshotsTest-1388171202-project] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] snap xml: Jun 26 10:38:07.447851 np0000003731 nova-compute[98967]: Jun 26 10:38:07.447851 np0000003731 nova-compute[98967]: Jun 26 10:38:07.447851 np0000003731 nova-compute[98967]: Jun 26 10:38:07.447851 np0000003731 nova-compute[98967]: Jun 26 10:38:07.447851 np0000003731 nova-compute[98967]: Jun 26 10:38:07.447851 np0000003731 nova-compute[98967]: Jun 26 10:38:07.447851 np0000003731 nova-compute[98967]: Jun 26 10:38:07.447851 np0000003731 nova-compute[98967]: Jun 26 10:38:07.447851 np0000003731 nova-compute[98967]: {{(pid=98967) _volume_snapshot_create /opt/stack/nova/nova/virt/libvirt/driver.py:3700}} Jun 26 10:38:07.450102 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-0a02ad7e-77ff-4d2a-a792-1136aeab5419 tempest-VolumesAssistedSnapshotsTest-1388171202 tempest-VolumesAssistedSnapshotsTest-1388171202-project] Lazy-loading 'system_metadata' on Instance uuid 5bc6474f-1a05-4e8a-9553-a5597c60728d {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:07.455365 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-32136da7-9fd9-40ae-8249-b89818ef8e1e tempest-VolumesAssistedSnapshotsTest-1388171202 tempest-VolumesAssistedSnapshotsTest-1388171202-project] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] volume_snapshot_delete: delete_info: {'volume_id': '018e1ebd-997e-4cdb-833c-31a4add20d1d'} {{(pid=98967) _volume_snapshot_delete /opt/stack/nova/nova/virt/libvirt/driver.py:3867}} Jun 26 10:38:07.460309 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [None req-32136da7-9fd9-40ae-8249-b89818ef8e1e tempest-VolumesAssistedSnapshotsTest-1388171202 tempest-VolumesAssistedSnapshotsTest-1388171202-project] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Error occurred during volume_snapshot_delete, sending error status to Cinder.: KeyError: 'type' Jun 26 10:38:07.460309 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Traceback (most recent call last): Jun 26 10:38:07.460309 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4040, in volume_snapshot_delete Jun 26 10:38:07.460309 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] self._volume_snapshot_delete(context, instance, volume_id, Jun 26 10:38:07.460309 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3870, in _volume_snapshot_delete Jun 26 10:38:07.460309 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] if delete_info['type'] != 'qcow2': Jun 26 10:38:07.460309 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] ~~~~~~~~~~~^^^^^^^^ Jun 26 10:38:07.460309 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] KeyError: 'type' Jun 26 10:38:07.460309 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Jun 26 10:38:07.482905 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): nvme version {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [None req-32136da7-9fd9-40ae-8249-b89818ef8e1e tempest-VolumesAssistedSnapshotsTest-1388171202 tempest-VolumesAssistedSnapshotsTest-1388171202-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot None could not be found. Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4040, in volume_snapshot_delete Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver self._volume_snapshot_delete(context, instance, volume_id, Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3870, in _volume_snapshot_delete Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver if delete_info['type'] != 'qcow2': Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver ~~~~~~~~~~~^^^^^^^^ Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver KeyError: 'type' Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot None could not be found. (HTTP 404) (Request-ID: req-fa649e17-831a-44c8-b766-e00ce0e33caa) Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3599, in _volume_snapshot_update_status Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver self._volume_api.update_snapshot_status(context, Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver res = method(self, ctx, *args, **kwargs) Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot None could not be found. Jun 26 10:38:07.523039 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver Jun 26 10:38:07.537137 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] 'nvme version' failed. Not Retrying. {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 10:38:07.537137 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.nvmeof [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] nvme not present on system {{(pid=98967) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server [None req-32136da7-9fd9-40ae-8249-b89818ef8e1e tempest-VolumesAssistedSnapshotsTest-1388171202 tempest-VolumesAssistedSnapshotsTest-1388171202-project] Exception during message handling: KeyError: 'type' Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server self.force_reraise() Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server raise self.value Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kw) Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 4829, in volume_snapshot_delete Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server self.driver.volume_snapshot_delete(context, instance, volume_id, Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4043, in volume_snapshot_delete Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server self.force_reraise() Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server raise self.value Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 4040, in volume_snapshot_delete Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server self._volume_snapshot_delete(context, instance, volume_id, Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3870, in _volume_snapshot_delete Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server if delete_info['type'] != 'qcow2': Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server ~~~~~~~~~~~^^^^^^^^ Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server KeyError: 'type' Jun 26 10:38:07.539464 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server Jun 26 10:38:07.541290 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98967) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 10:38:07.542305 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.lightos [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Current host hostNQN and IP(s) are ['10.4.3.79', 'fe80::f816:3eff:fe55:ba34', '192.168.40.6', 'fe80::f816:3eff:fe6b:fe1a', '192.168.50.6', 'fe80::f816:3eff:feca:9cd0', '192.168.10.6', 'fe80::f816:3eff:feb4:4e78', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f8bb:38ff:fe28:ff4a', 'fe80::fc16:3eff:fe37:b3f6', 'fe80::41a:feff:fe02:479d', 'fe80::fc16:3eff:fef2:11a', 'fe80::a061:7eff:feb6:8085', 'fe80::fc16:3eff:fe4b:6e75', 'fe80::fc16:3eff:fe3a:ece4', 'fe80::60f0:e4ff:fe6b:bf4c', 'fe80::fc16:3eff:fe5e:459', 'fe80::fc16:3eff:fe98:a56d', 'fe80::e0a3:7bff:fe72:d1ac', 'fe80::fc16:3eff:fe9b:2a95', 'fe80::fc16:3eff:fe0d:e858', 'fe80::fc16:3eff:fe89:3b98', 'fe80::fc16:3eff:fe4e:45ca', 'fe80::fc16:3eff:fefc:6266', 'fe80::c0fa:55ff:febf:197a', 'fe80::fc16:3eff:fe50:563a', 'fe80::8082:55ff:feee:9f56', 'fe80::fc16:3eff:fe90:be9c', 'fe80::fc16:3eff:fe1b:5509', 'fe80::84cb:23ff:fe8e:e6e6', 'fe80::fc16:3eff:fe5a:811a'] Jun 26 10:38:07.542305 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 10:38:07.542305 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] LIGHTOS: no hostnqn found. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 10:38:07.542305 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] <== get_connector_properties: return (127ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.79', 'host': 'np0000003731', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:2fddcc2116d6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '7f2a0776-2f14-4357-a22e-baa6677eb22e', 'nvme_native_multipath': False} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:38:07.542305 np0000003731 nova-compute[98967]: DEBUG nova.virt.block_device [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Updating existing volume attachment record: e73d09a6-53fd-4d04-8534-51e0d36e3078 {{(pid=98967) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 26 10:38:07.862096 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:07.921664 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-c850b564-0a93-4ada-994c-8e6802855783 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:36:49Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-AttachSCSIVolumeTestJSON-server-18998337',display_name='tempest-AttachSCSIVolumeTestJSON-server-18998337',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-attachscsivolumetestjson-server-18998337',id=4,image_ref='c7762ac8-b995-4f2a-95ee-9f4f6fdb855d',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB0hytWFUYbgBKclliRTkCyGe+x/WtHIDBhuf3tDCCDrHQ6HoV1OrTysz56hJWDdo2yh09ZOgzNBJu6oWGcUZ35ElB4GdjfCUuaXkg7q+zshkdODr42ewwRXnRS/Hc7xAg==',key_name='tempest-keypair-1365391156',keypairs=,launch_index=0,launched_at=2026-06-26T10:37:05Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='f37c91742d834881a1ec62e1eb1ecdcf',ramdisk_id='',reservation_id='r-cb6tcf00',resources=None,root_device_name='/dev/sda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='c7762ac8-b995-4f2a-95ee-9f4f6fdb855d',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='scsi',image_hw_disk_bus='scsi',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_scsi_model='virtio-scsi',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',owner_project_name='tempest-AttachSCSIVolumeTestJSON-1664188932',owner_user_name='tempest-AttachSCSIVolumeTestJSON-1664188932-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-26T10:37:06Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='c121ca0bdcf24093be4959e77345c328',uuid=c43215aa-be15-4556-8162-bcd9793048c0,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "85e3464e-eadb-4a6d-b3b5-073945346160", "address": "fa:16:3e:56:c7:74", "network": {"id": "640dfe2a-db65-4dfd-a073-17ac7680d2b0", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1874770241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f37c91742d834881a1ec62e1eb1ecdcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e3464e-ea", "ovs_interfaceid": "85e3464e-eadb-4a6d-b3b5-073945346160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 26 10:38:07.921879 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c850b564-0a93-4ada-994c-8e6802855783 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Converting VIF {"id": "85e3464e-eadb-4a6d-b3b5-073945346160", "address": "fa:16:3e:56:c7:74", "network": {"id": "640dfe2a-db65-4dfd-a073-17ac7680d2b0", "bridge": "br-int", "label": "tempest-AttachSCSIVolumeTestJSON-1874770241-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.171", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f37c91742d834881a1ec62e1eb1ecdcf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap85e3464e-ea", "ovs_interfaceid": "85e3464e-eadb-4a6d-b3b5-073945346160", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:38:07.930142 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c850b564-0a93-4ada-994c-8e6802855783 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:56:c7:74,bridge_name='br-int',has_traffic_filtering=True,id=85e3464e-eadb-4a6d-b3b5-073945346160,network=Network(640dfe2a-db65-4dfd-a073-17ac7680d2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e3464e-ea') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:38:07.930142 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-c850b564-0a93-4ada-994c-8e6802855783 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:c7:74,bridge_name='br-int',has_traffic_filtering=True,id=85e3464e-eadb-4a6d-b3b5-073945346160,network=Network(640dfe2a-db65-4dfd-a073-17ac7680d2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e3464e-ea') {{(pid=98967) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 26 10:38:07.930142 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:07.930142 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap85e3464e-ea, bridge=br-int, if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:07.953259 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:07.953259 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:07.953259 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:07.953259 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:07.953259 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ad29d746-0627-488f-8981-a2007d838045) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:07.953259 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:07.953259 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:07.953259 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:07.953259 np0000003731 nova-compute[98967]: INFO os_vif [None req-c850b564-0a93-4ada-994c-8e6802855783 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:56:c7:74,bridge_name='br-int',has_traffic_filtering=True,id=85e3464e-eadb-4a6d-b3b5-073945346160,network=Network(640dfe2a-db65-4dfd-a073-17ac7680d2b0),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap85e3464e-ea') Jun 26 10:38:07.953259 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-c850b564-0a93-4ada-994c-8e6802855783 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Deleting instance files /opt/stack/data/nova/instances/c43215aa-be15-4556-8162-bcd9793048c0_del Jun 26 10:38:07.953259 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-c850b564-0a93-4ada-994c-8e6802855783 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Deletion of /opt/stack/data/nova/instances/c43215aa-be15-4556-8162-bcd9793048c0_del complete Jun 26 10:38:07.953677 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-0a02ad7e-77ff-4d2a-a792-1136aeab5419 tempest-VolumesAssistedSnapshotsTest-1388171202 tempest-VolumesAssistedSnapshotsTest-1388171202-project] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Skipping quiescing instance: QEMU guest agent is not enabled. Jun 26 10:38:07.965236 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [None req-0a02ad7e-77ff-4d2a-a792-1136aeab5419 tempest-VolumesAssistedSnapshotsTest-1388171202 tempest-VolumesAssistedSnapshotsTest-1388171202-project] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Unable to create VM snapshot, failing volume_snapshot operation.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 26 10:38:07.965236 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Traceback (most recent call last): Jun 26 10:38:07.965236 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3727, in _volume_snapshot_create Jun 26 10:38:07.965236 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jun 26 10:38:07.965236 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jun 26 10:38:07.965236 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] self._domain.snapshotCreateXML(device_xml, flags=flags) Jun 26 10:38:07.965236 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jun 26 10:38:07.965236 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] raise libvirtError('virDomainSnapshotCreateXML() failed') Jun 26 10:38:07.965236 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 26 10:38:07.965236 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Jun 26 10:38:07.965920 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [None req-0a02ad7e-77ff-4d2a-a792-1136aeab5419 tempest-VolumesAssistedSnapshotsTest-1388171202 tempest-VolumesAssistedSnapshotsTest-1388171202-project] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Error occurred during volume_snapshot_create, sending error status to Cinder.: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 26 10:38:07.965920 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Traceback (most recent call last): Jun 26 10:38:07.965920 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3777, in volume_snapshot_create Jun 26 10:38:07.965920 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] self._volume_snapshot_create(context, instance, guest, Jun 26 10:38:07.965920 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3727, in _volume_snapshot_create Jun 26 10:38:07.965920 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jun 26 10:38:07.965920 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jun 26 10:38:07.965920 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] self._domain.snapshotCreateXML(device_xml, flags=flags) Jun 26 10:38:07.965920 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jun 26 10:38:07.965920 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] raise libvirtError('virDomainSnapshotCreateXML() failed') Jun 26 10:38:07.965920 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 26 10:38:07.965920 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver [None req-0a02ad7e-77ff-4d2a-a792-1136aeab5419 tempest-VolumesAssistedSnapshotsTest-1388171202 tempest-VolumesAssistedSnapshotsTest-1388171202-project] Failed to send updated snapshot status to volume service.: nova.exception.SnapshotNotFound: Snapshot 762846f0-43d4-4edc-ba34-33bfad369855 could not be found. Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3777, in volume_snapshot_create Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver self._volume_snapshot_create(context, instance, guest, Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3727, in _volume_snapshot_create Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver self._domain.snapshotCreateXML(device_xml, flags=flags) Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver raise libvirtError('virDomainSnapshotCreateXML() failed') Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver cinderclient.exceptions.NotFound: Snapshot 762846f0-43d4-4edc-ba34-33bfad369855 could not be found. (HTTP 404) (Request-ID: req-628298c0-aa93-4821-a2e3-d65aeb352859) Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver During handling of the above exception, another exception occurred: Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver Traceback (most recent call last): Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3599, in _volume_snapshot_update_status Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver self._volume_api.update_snapshot_status(context, Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 376, in wrapper Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver res = method(self, ctx, *args, **kwargs) Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 447, in wrapper Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 467, in _reraise Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 445, in wrapper Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/nova/nova/volume/cinder.py", line 740, in update_snapshot_status Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver vs.update_snapshot_status( Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 225, in update_snapshot_status Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver return self._action('os-update_snapshot_status', Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/v3/volume_snapshots.py", line 221, in _action Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver resp, body = self.api.client.post(url, body=body) Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 223, in post Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver return self._cs_request(url, 'POST', **kwargs) Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 211, in _cs_request Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver return self.request(url, method, **kwargs) Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver File "/opt/stack/data/venv/lib/python3.12/site-packages/cinderclient/client.py", line 197, in request Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver raise exceptions.from_response(resp, body) Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver nova.exception.SnapshotNotFound: Snapshot 762846f0-43d4-4edc-ba34-33bfad369855 could not be found. Jun 26 10:38:08.001521 np0000003731 nova-compute[98967]: ERROR nova.virt.libvirt.driver Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server [None req-0a02ad7e-77ff-4d2a-a792-1136aeab5419 tempest-VolumesAssistedSnapshotsTest-1388171202 tempest-VolumesAssistedSnapshotsTest-1388171202-project] Exception during message handling: libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 174, in _process_incoming Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 269, in inner Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server return func(*args, **kwargs) Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 65, in wrapped Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server self.force_reraise() Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server raise self.value Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/exception_wrapper.py", line 63, in wrapped Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server return f(self, context, *args, **kw) Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/compute/manager.py", line 4817, in volume_snapshot_create Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server self.driver.volume_snapshot_create(context, instance, volume_id, Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3780, in volume_snapshot_create Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server with excutils.save_and_reraise_exception(): Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 266, in __exit__ Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server self.force_reraise() Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/excutils.py", line 232, in force_reraise Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server raise self.value Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3777, in volume_snapshot_create Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server self._volume_snapshot_create(context, instance, guest, Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/driver.py", line 3727, in _volume_snapshot_create Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server guest.snapshot(snapshot, no_metadata=True, disk_only=True, Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server File "/opt/stack/nova/nova/virt/libvirt/guest.py", line 583, in snapshot Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server self._domain.snapshotCreateXML(device_xml, flags=flags) Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server File "/usr/lib/python3/dist-packages/libvirt.py", line 3125, in snapshotCreateXML Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server raise libvirtError('virDomainSnapshotCreateXML() failed') Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server libvirt.libvirtError: missing existing file for disk vdb: /dev/new_file: No such file or directory Jun 26 10:38:08.004656 np0000003731 nova-compute[98967]: ERROR oslo_messaging.rpc.server Jun 26 10:38:08.039957 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Updating instance_info_cache with network_info: [{"id": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "address": "fa:16:3e:4c:ec:5e", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ae095e-5d", "ovs_interfaceid": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:38:08.138440 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Calling os-brick to attach iSCSI Volume {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 26 10:38:08.138440 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47', 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47f52d31-fbea-432a-bdb6-e4f813146c47', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:38:08.138940 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:38:08.138940 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:38:08.139417 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47', 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47f52d31-fbea-432a-bdb6-e4f813146c47', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 10:38:08.153452 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:38:08.158918 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:38:08.158918 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.007s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.startup = automatic Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.scan = manual Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.40.100 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.startup = automatic Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.scan = manual Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.50.100 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:38:08.185292 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:08.204439 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:08.204439 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.049s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Connected to 192.168.40.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] HCTL ('19', '0', '0', 0) found on session 16 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:38:08.216830 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Scanning host 19 c: 0, t: 0, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.057s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Connected to 192.168.50.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Searching for a device in session 16 and hctl ('19', '0', '0', 0) yield: sdn {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47f52d31-fbea-432a-bdb6-e4f813146c47', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] HCTL ('20', '0', '0', 0) found on session 17 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:38:08.225286 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Scanning host 20 c: 0, t: 0, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:38:08.231461 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Searching for a device in session 17 and hctl ('20', '0', '0', 0) yield: sdo {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:38:08.231461 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '47f52d31-fbea-432a-bdb6-e4f813146c47', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:38:08.288569 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Acquiring lock "5bc6474f-1a05-4e8a-9553-a5597c60728d" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:08.288795 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Lock "5bc6474f-1a05-4e8a-9553-a5597c60728d" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:08.451488 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-c850b564-0a93-4ada-994c-8e6802855783 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Took 1.57 seconds to destroy the instance on the hypervisor. Jun 26 10:38:08.452381 np0000003731 nova-compute[98967]: DEBUG oslo.service.backend._common.loopingcall [None req-c850b564-0a93-4ada-994c-8e6802855783 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98967) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 26 10:38:08.452711 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [-] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Deallocating network for instance {{(pid=98967) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 26 10:38:08.452840 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [-] [instance: c43215aa-be15-4556-8162-bcd9793048c0] deallocate_for_instance() {{(pid=98967) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 26 10:38:08.453067 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:08.543864 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Releasing lock "refresh_cache-81a0f65d-2017-4275-aabe-88bc8c81225d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:38:08.545183 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Creating instance directory {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 26 10:38:08.545468 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-523d7c9e-5da2-4b4e-bb5e-d43690eb3149 req-3a88a529-8e13-432f-8a91-62782612acce service nova] Acquired lock "refresh_cache-81a0f65d-2017-4275-aabe-88bc8c81225d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:38:08.545701 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-523d7c9e-5da2-4b4e-bb5e-d43690eb3149 req-3a88a529-8e13-432f-8a91-62782612acce service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Refreshing network info cache for port b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:38:08.546648 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Creating image(s) Jun 26 10:38:08.547379 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "/opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:08.547534 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "/opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:08.547978 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "/opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:08.548340 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lazy-loading 'trusted_certs' on Instance uuid 81a0f65d-2017-4275-aabe-88bc8c81225d {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:08.576192 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:08.612045 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Removed pending STOPPED event for 25b12be8-e92b-4705-b668-05cfecaf66b3 due to new event Resumed> {{(pid=98967) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 26 10:38:08.612045 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:38:08.612045 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] VM Resumed (Lifecycle Event) Jun 26 10:38:08.620629 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-f9196f2b-518e-486f-a2d7-3552077a9178 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:08.774577 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:38:08.774717 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:38:08.774796 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:38:08.774898 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] No VIF found with MAC fa:16:3e:4b:6e:75, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:38:08.792956 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Detaching volume 018e1ebd-997e-4cdb-833c-31a4add20d1d Jun 26 10:38:08.840397 np0000003731 nova-compute[98967]: INFO nova.virt.block_device [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Attempting to driver detach volume 018e1ebd-997e-4cdb-833c-31a4add20d1d from mountpoint /dev/vdb Jun 26 10:38:08.845657 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Found disk vdb by alias ua-018e1ebd-997e-4cdb-833c-31a4add20d1d {{(pid=98967) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 26 10:38:08.847187 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Found disk vdb by alias ua-018e1ebd-997e-4cdb-833c-31a4add20d1d {{(pid=98967) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 26 10:38:08.847305 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Attempting to detach device vdb from instance 5bc6474f-1a05-4e8a-9553-a5597c60728d from the persistent domain config. {{(pid=98967) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 26 10:38:08.847662 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] detach device xml: Jun 26 10:38:08.847662 np0000003731 nova-compute[98967]: Jun 26 10:38:08.847662 np0000003731 nova-compute[98967]: Jun 26 10:38:08.847662 np0000003731 nova-compute[98967]: Jun 26 10:38:08.847662 np0000003731 nova-compute[98967]: Jun 26 10:38:08.847662 np0000003731 nova-compute[98967]: 018e1ebd-997e-4cdb-833c-31a4add20d1d Jun 26 10:38:08.847662 np0000003731 nova-compute[98967]:
Jun 26 10:38:08.847662 np0000003731 nova-compute[98967]: Jun 26 10:38:08.847662 np0000003731 nova-compute[98967]: {{(pid=98967) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 26 10:38:08.857082 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Successfully detached device vdb from instance 5bc6474f-1a05-4e8a-9553-a5597c60728d from the persistent domain config. Jun 26 10:38:08.857221 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] (1/8): Attempting to detach device vdb with device alias ua-018e1ebd-997e-4cdb-833c-31a4add20d1d from instance 5bc6474f-1a05-4e8a-9553-a5597c60728d from the live domain config. {{(pid=98967) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 26 10:38:08.857458 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] detach device xml: Jun 26 10:38:08.857458 np0000003731 nova-compute[98967]: Jun 26 10:38:08.857458 np0000003731 nova-compute[98967]: Jun 26 10:38:08.857458 np0000003731 nova-compute[98967]: Jun 26 10:38:08.857458 np0000003731 nova-compute[98967]: Jun 26 10:38:08.857458 np0000003731 nova-compute[98967]: 018e1ebd-997e-4cdb-833c-31a4add20d1d Jun 26 10:38:08.857458 np0000003731 nova-compute[98967]:
Jun 26 10:38:08.857458 np0000003731 nova-compute[98967]: Jun 26 10:38:08.857458 np0000003731 nova-compute[98967]: {{(pid=98967) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 26 10:38:09.049921 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-523d7c9e-5da2-4b4e-bb5e-d43690eb3149 req-3a88a529-8e13-432f-8a91-62782612acce service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:09.051578 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Object Instance<81a0f65d-2017-4275-aabe-88bc8c81225d> lazy-loaded attributes: pci_requests,trusted_certs {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:38:09.052501 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "eeee0ae2bc21e19fa9ff0a5f90f11cc7d47b8f00" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:09.052844 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "eeee0ae2bc21e19fa9ff0a5f90f11cc7d47b8f00" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:09.114557 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:09.121147 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:38:09.159510 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 26 10:38:09.355896 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:09.424583 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-98b3bbd6-80d4-4d95-8165-37e92d1296f8 req-36227d83-f966-4958-8b87-b167caca93d2 service nova] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Received event network-vif-unplugged-85e3464e-eadb-4a6d-b3b5-073945346160 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:09.424697 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-98b3bbd6-80d4-4d95-8165-37e92d1296f8 req-36227d83-f966-4958-8b87-b167caca93d2 service nova] Acquiring lock "c43215aa-be15-4556-8162-bcd9793048c0-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:09.424815 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-98b3bbd6-80d4-4d95-8165-37e92d1296f8 req-36227d83-f966-4958-8b87-b167caca93d2 service nova] Lock "c43215aa-be15-4556-8162-bcd9793048c0-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:09.424945 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-98b3bbd6-80d4-4d95-8165-37e92d1296f8 req-36227d83-f966-4958-8b87-b167caca93d2 service nova] Lock "c43215aa-be15-4556-8162-bcd9793048c0-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:09.425061 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-98b3bbd6-80d4-4d95-8165-37e92d1296f8 req-36227d83-f966-4958-8b87-b167caca93d2 service nova] [instance: c43215aa-be15-4556-8162-bcd9793048c0] No waiting events found dispatching network-vif-unplugged-85e3464e-eadb-4a6d-b3b5-073945346160 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:09.425186 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-98b3bbd6-80d4-4d95-8165-37e92d1296f8 req-36227d83-f966-4958-8b87-b167caca93d2 service nova] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Received event network-vif-unplugged-85e3464e-eadb-4a6d-b3b5-073945346160 for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:38:09.466256 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Start waiting for the detach event from libvirt for device vdb with device alias ua-018e1ebd-997e-4cdb-833c-31a4add20d1d for instance 5bc6474f-1a05-4e8a-9553-a5597c60728d {{(pid=98967) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 26 10:38:09.574812 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-14b44a55-6a34-4c9c-9e0f-26aaa1db9e5d req-cbf7305b-25fc-47c8-b596-bd54a35a9f60 service nova] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Received event network-vif-plugged-13baed68-e3c0-4f72-8ccd-0cc2c4cd3552 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:09.578084 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-14b44a55-6a34-4c9c-9e0f-26aaa1db9e5d req-cbf7305b-25fc-47c8-b596-bd54a35a9f60 service nova] Acquiring lock "25b12be8-e92b-4705-b668-05cfecaf66b3-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:09.578869 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-14b44a55-6a34-4c9c-9e0f-26aaa1db9e5d req-cbf7305b-25fc-47c8-b596-bd54a35a9f60 service nova] Lock "25b12be8-e92b-4705-b668-05cfecaf66b3-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:09.578969 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-14b44a55-6a34-4c9c-9e0f-26aaa1db9e5d req-cbf7305b-25fc-47c8-b596-bd54a35a9f60 service nova] Lock "25b12be8-e92b-4705-b668-05cfecaf66b3-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:09.579134 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-14b44a55-6a34-4c9c-9e0f-26aaa1db9e5d req-cbf7305b-25fc-47c8-b596-bd54a35a9f60 service nova] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] No waiting events found dispatching network-vif-plugged-13baed68-e3c0-4f72-8ccd-0cc2c4cd3552 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:09.579251 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-14b44a55-6a34-4c9c-9e0f-26aaa1db9e5d req-cbf7305b-25fc-47c8-b596-bd54a35a9f60 service nova] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Received unexpected event network-vif-plugged-13baed68-e3c0-4f72-8ccd-0cc2c4cd3552 for instance with vm_state rescued and task_state None. Jun 26 10:38:09.624908 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:38:09.625129 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] VM Started (Lifecycle Event) Jun 26 10:38:09.653809 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-523d7c9e-5da2-4b4e-bb5e-d43690eb3149 req-3a88a529-8e13-432f-8a91-62782612acce service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:10.020527 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-523d7c9e-5da2-4b4e-bb5e-d43690eb3149 req-3a88a529-8e13-432f-8a91-62782612acce service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Updated VIF entry in instance network info cache for port b6ae095e-5da6-45dd-95bd-47cf007120c3. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:38:10.034272 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-523d7c9e-5da2-4b4e-bb5e-d43690eb3149 req-3a88a529-8e13-432f-8a91-62782612acce service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Updating instance_info_cache with network_info: [{"id": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "address": "fa:16:3e:4c:ec:5e", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ae095e-5d", "ovs_interfaceid": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:38:10.073316 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-350fc0d1-ffa1-4de8-a007-bdc49d9fa4b0 req-8c080b29-cf3f-499c-a7e0-ed95dc3d5e1c service nova] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Received event network-vif-deleted-85e3464e-eadb-4a6d-b3b5-073945346160 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:10.073627 np0000003731 nova-compute[98967]: INFO nova.compute.manager [req-350fc0d1-ffa1-4de8-a007-bdc49d9fa4b0 req-8c080b29-cf3f-499c-a7e0-ed95dc3d5e1c service nova] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Neutron deleted interface 85e3464e-eadb-4a6d-b3b5-073945346160; detaching it from the instance and deleting it from the info cache Jun 26 10:38:10.078994 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-350fc0d1-ffa1-4de8-a007-bdc49d9fa4b0 req-8c080b29-cf3f-499c-a7e0-ed95dc3d5e1c service nova] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Detach interface failed, port_id=85e3464e-eadb-4a6d-b3b5-073945346160, reason: Instance c43215aa-be15-4556-8162-bcd9793048c0 could not be found. {{(pid=98967) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 26 10:38:10.127724 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:10.129389 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 25b12be8-e92b-4705-b668-05cfecaf66b3] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:38:10.181577 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Found WWN 330000000f0f4940b for multipath device dm-10 {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 26 10:38:10.181984 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.043s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:38:10.182266 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] <== connect_volume: return (2043ms) {'type': 'block', 'scsi_wwn': '330000000f0f4940b', 'path': '/dev/dm-10', 'multipath_id': '330000000f0f4940b'} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:38:10.182522 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000f0f4940b', 'path': '/dev/dm-10', 'multipath_id': '330000000f0f4940b'} {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 26 10:38:10.184672 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lazy-loading 'flavor' on Instance uuid 212147b0-26de-42cd-b43d-057ec8d61c72 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:10.412249 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7982ee62-7c4b-459e-912a-d2b5d2d09681 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "64a636b4-e106-4968-8740-9938e9b2bcc8" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 6.632s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:10.505265 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [-] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:38:10.533950 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-523d7c9e-5da2-4b4e-bb5e-d43690eb3149 req-3a88a529-8e13-432f-8a91-62782612acce service nova] Releasing lock "refresh_cache-81a0f65d-2017-4275-aabe-88bc8c81225d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:38:10.634902 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Received event ua-018e1ebd-997e-4cdb-833c-31a4add20d1d> from libvirt while the driver is waiting for it; dispatched. {{(pid=98967) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 26 10:38:10.638799 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Successfully detached device vdb from instance 5bc6474f-1a05-4e8a-9553-a5597c60728d from the live domain config. Jun 26 10:38:10.640039 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] calling os-brick to detach iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 26 10:38:10.640378 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d', 'iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '018e1ebd-997e-4cdb-833c-31a4add20d1d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, None), 'kwargs': {'force': False}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:38:10.640556 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:38:10.641428 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:38:10.641428 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d', 'iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '018e1ebd-997e-4cdb-833c-31a4add20d1d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-11'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 10:38:10.641428 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d', 0)] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 10:38:10.652704 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:10.658084 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:10.658084 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeee0ae2bc21e19fa9ff0a5f90f11cc7d47b8f00.part --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:10.676394 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:10.676394 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:10.676394 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:10.676394 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:10.676394 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:10.676394 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:10.676394 np0000003731 nova-compute[98967]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:10.676394 np0000003731 nova-compute[98967]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:10.676394 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:10.676394 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:10.676394 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:10.676394 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:10.676394 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:10.676394 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:10.676394 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:38:10.678075 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:10.678075 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:10.678075 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:10.678075 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:10.678075 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:10.678075 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:10.678075 np0000003731 nova-compute[98967]: tcp: [18] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:10.678075 np0000003731 nova-compute[98967]: tcp: [19] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d (non-flash) Jun 26 10:38:10.678075 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:10.678075 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:10.678075 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:10.678075 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:10.678075 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:10.678075 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:10.678075 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:38:10.678075 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b', '15'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47', '16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d', '18'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d', '19'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020', '7'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77', '9')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 10:38:10.680376 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d', '18')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:38:10.681945 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d', '19')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:38:10.685399 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Resulting device map defaultdict(. at 0x75f0704f6020>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d'): ({'sdq'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d'): ({'sdp'}, set())}) {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 10:38:10.686949 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Removing multipathed devices sdp, sdq {{(pid=98967) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 10:38:10.689491 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Attempting to attach volume 47f52d31-fbea-432a-bdb6-e4f813146c47 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98967) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 26 10:38:10.689865 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Flush multipath device 3300000007f711b96 {{(pid=98967) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 26 10:38:10.691973 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] attach device xml: Jun 26 10:38:10.691973 np0000003731 nova-compute[98967]: Jun 26 10:38:10.691973 np0000003731 nova-compute[98967]: Jun 26 10:38:10.691973 np0000003731 nova-compute[98967]: Jun 26 10:38:10.691973 np0000003731 nova-compute[98967]: Jun 26 10:38:10.691973 np0000003731 nova-compute[98967]: 47f52d31-fbea-432a-bdb6-e4f813146c47 Jun 26 10:38:10.691973 np0000003731 nova-compute[98967]: Jun 26 10:38:10.691973 np0000003731 nova-compute[98967]: Jun 26 10:38:10.691973 np0000003731 nova-compute[98967]: {{(pid=98967) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 26 10:38:10.729530 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:38:10.743496 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeee0ae2bc21e19fa9ff0a5f90f11cc7d47b8f00.part --force-share --output=json" returned: 0 in 0.086s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:10.743893 np0000003731 nova-compute[98967]: DEBUG nova.virt.images [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] 3155480a-a06f-4039-8ee3-f855ef330399 was qcow2, converting to raw {{(pid=98967) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 26 10:38:10.744551 np0000003731 nova-compute[98967]: DEBUG nova.privsep.utils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98967) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 26 10:38:10.744862 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eeee0ae2bc21e19fa9ff0a5f90f11cc7d47b8f00.part /opt/stack/data/nova/instances/_base/eeee0ae2bc21e19fa9ff0a5f90f11cc7d47b8f00.converted {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:10.776403 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Remove SCSI device /dev/sdq with /sys/block/sdq/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:38:10.824116 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Checking to see if SCSI volumes sdp, sdq have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 10:38:10.824116 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] SCSI volumes sdp, sdq have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 10:38:10.825454 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Checking to see if device paths {'sdp', 'sdq'} are still under multipathd monitoring {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 10:38:10.835228 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Device paths {'sdp', 'sdq'} have been removed from multipathd monitoring. {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 10:38:10.835458 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d')] {{(pid=98967) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 10:38:10.847372 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:10.883629 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 18, target: iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d, portal: 192.168.40.100,3260] Jun 26 10:38:10.883629 np0000003731 nova-compute[98967]: Logout of [sid: 18, target: iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d, portal: 192.168.40.100,3260] successful. Jun 26 10:38:10.883629 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:10.905256 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:10.915262 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:10.956634 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] iscsiadm ('--logout',): stdout=Logging out of session [sid: 19, target: iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d, portal: 192.168.50.100,3260] Jun 26 10:38:10.956634 np0000003731 nova-compute[98967]: Logout of [sid: 19, target: iqn.2023-03.storpool.com:os--volume-018e1ebd-997e-4cdb-833c-31a4add20d1d, portal: 192.168.50.100,3260] successful. Jun 26 10:38:10.956634 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:10.975157 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:10.975535 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.335s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:38:10.975725 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] <== disconnect_volume: return (335ms) None {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:38:10.975888 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Disconnected iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 26 10:38:11.004476 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/eeee0ae2bc21e19fa9ff0a5f90f11cc7d47b8f00.part /opt/stack/data/nova/instances/_base/eeee0ae2bc21e19fa9ff0a5f90f11cc7d47b8f00.converted" returned: 0 in 0.259s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:11.007771 np0000003731 nova-compute[98967]: INFO nova.compute.manager [-] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Took 2.55 seconds to deallocate network for instance. Jun 26 10:38:11.017355 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeee0ae2bc21e19fa9ff0a5f90f11cc7d47b8f00.converted --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:11.093672 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeee0ae2bc21e19fa9ff0a5f90f11cc7d47b8f00.converted --force-share --output=json" returned: 0 in 0.076s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:11.094463 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "eeee0ae2bc21e19fa9ff0a5f90f11cc7d47b8f00" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 2.042s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:11.095078 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:11.098704 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:11.100436 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeee0ae2bc21e19fa9ff0a5f90f11cc7d47b8f00 --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:11.187544 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeee0ae2bc21e19fa9ff0a5f90f11cc7d47b8f00 --force-share --output=json" returned: 0 in 0.087s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:11.188195 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "eeee0ae2bc21e19fa9ff0a5f90f11cc7d47b8f00" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:11.188739 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "eeee0ae2bc21e19fa9ff0a5f90f11cc7d47b8f00" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:11.189339 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:11.193214 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:11.193728 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeee0ae2bc21e19fa9ff0a5f90f11cc7d47b8f00 --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:11.270065 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2714945e-c2c5-4862-80bf-5fcaee63c385 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "64a636b4-e106-4968-8740-9938e9b2bcc8" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:11.270632 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2714945e-c2c5-4862-80bf-5fcaee63c385 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "64a636b4-e106-4968-8740-9938e9b2bcc8" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:11.278393 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeee0ae2bc21e19fa9ff0a5f90f11cc7d47b8f00 --force-share --output=json" returned: 0 in 0.084s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:11.278955 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eeee0ae2bc21e19fa9ff0a5f90f11cc7d47b8f00,backing_fmt=raw /opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d/disk 1073741824 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:11.319531 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/eeee0ae2bc21e19fa9ff0a5f90f11cc7d47b8f00,backing_fmt=raw /opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d/disk 1073741824" returned: 0 in 0.040s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:11.319973 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "eeee0ae2bc21e19fa9ff0a5f90f11cc7d47b8f00" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.131s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:11.320332 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeee0ae2bc21e19fa9ff0a5f90f11cc7d47b8f00 --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:11.403332 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/eeee0ae2bc21e19fa9ff0a5f90f11cc7d47b8f00 --force-share --output=json" returned: 0 in 0.083s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:11.403931 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lazy-loading 'migration_context' on Instance uuid 81a0f65d-2017-4275-aabe-88bc8c81225d {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:11.514789 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c850b564-0a93-4ada-994c-8e6802855783 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:11.514975 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c850b564-0a93-4ada-994c-8e6802855783 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:11.533496 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Lazy-loading 'flavor' on Instance uuid 5bc6474f-1a05-4e8a-9553-a5597c60728d {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:11.773368 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-2714945e-c2c5-4862-80bf-5fcaee63c385 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Detaching volume 243799f9-5b48-488a-9a05-c0ca1141a23b Jun 26 10:38:11.832036 np0000003731 nova-compute[98967]: INFO nova.virt.block_device [None req-2714945e-c2c5-4862-80bf-5fcaee63c385 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Attempting to driver detach volume 243799f9-5b48-488a-9a05-c0ca1141a23b from mountpoint /dev/vdb Jun 26 10:38:11.849688 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-2714945e-c2c5-4862-80bf-5fcaee63c385 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Found disk vdb by alias ua-243799f9-5b48-488a-9a05-c0ca1141a23b {{(pid=98967) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 26 10:38:11.852081 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-2714945e-c2c5-4862-80bf-5fcaee63c385 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Found disk vdb by alias ua-243799f9-5b48-488a-9a05-c0ca1141a23b {{(pid=98967) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 26 10:38:11.852081 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-2714945e-c2c5-4862-80bf-5fcaee63c385 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Attempting to detach device vdb from instance 64a636b4-e106-4968-8740-9938e9b2bcc8 from the persistent domain config. {{(pid=98967) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 26 10:38:11.854272 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-2714945e-c2c5-4862-80bf-5fcaee63c385 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] detach device xml: Jun 26 10:38:11.854272 np0000003731 nova-compute[98967]: Jun 26 10:38:11.854272 np0000003731 nova-compute[98967]: Jun 26 10:38:11.854272 np0000003731 nova-compute[98967]: Jun 26 10:38:11.854272 np0000003731 nova-compute[98967]: Jun 26 10:38:11.854272 np0000003731 nova-compute[98967]: 243799f9-5b48-488a-9a05-c0ca1141a23b Jun 26 10:38:11.854272 np0000003731 nova-compute[98967]: Jun 26 10:38:11.854272 np0000003731 nova-compute[98967]:
Jun 26 10:38:11.854272 np0000003731 nova-compute[98967]: Jun 26 10:38:11.854272 np0000003731 nova-compute[98967]: {{(pid=98967) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 26 10:38:11.863566 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-2714945e-c2c5-4862-80bf-5fcaee63c385 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Successfully detached device vdb from instance 64a636b4-e106-4968-8740-9938e9b2bcc8 from the persistent domain config. Jun 26 10:38:11.863676 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-2714945e-c2c5-4862-80bf-5fcaee63c385 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] (1/8): Attempting to detach device vdb with device alias ua-243799f9-5b48-488a-9a05-c0ca1141a23b from instance 64a636b4-e106-4968-8740-9938e9b2bcc8 from the live domain config. {{(pid=98967) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 26 10:38:11.863941 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-2714945e-c2c5-4862-80bf-5fcaee63c385 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] detach device xml: Jun 26 10:38:11.863941 np0000003731 nova-compute[98967]: Jun 26 10:38:11.863941 np0000003731 nova-compute[98967]: Jun 26 10:38:11.863941 np0000003731 nova-compute[98967]: Jun 26 10:38:11.863941 np0000003731 nova-compute[98967]: Jun 26 10:38:11.863941 np0000003731 nova-compute[98967]: 243799f9-5b48-488a-9a05-c0ca1141a23b Jun 26 10:38:11.863941 np0000003731 nova-compute[98967]: Jun 26 10:38:11.863941 np0000003731 nova-compute[98967]:
Jun 26 10:38:11.863941 np0000003731 nova-compute[98967]: Jun 26 10:38:11.863941 np0000003731 nova-compute[98967]: {{(pid=98967) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 26 10:38:11.908172 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Object Instance<81a0f65d-2017-4275-aabe-88bc8c81225d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:38:11.908551 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Rebasing disk image. Jun 26 10:38:11.908799 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:11.982953 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.074s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:11.983345 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe -F raw /opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d/disk {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:12.252660 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c850b564-0a93-4ada-994c-8e6802855783 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:38:12.252660 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-c850b564-0a93-4ada-994c-8e6802855783 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:38:12.272273 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Rescuing Jun 26 10:38:12.272273 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "refresh_cache-047061b2-340c-4cc9-899b-0744dad0081f" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:38:12.272273 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquired lock "refresh_cache-047061b2-340c-4cc9-899b-0744dad0081f" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:38:12.272273 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:38:12.372082 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:38:12.372232 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:38:12.372338 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:38:12.372685 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No VIF found with MAC fa:16:3e:90:be:9c, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:38:12.385046 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Received event ua-243799f9-5b48-488a-9a05-c0ca1141a23b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98967) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 26 10:38:12.385799 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-2714945e-c2c5-4862-80bf-5fcaee63c385 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-243799f9-5b48-488a-9a05-c0ca1141a23b for instance 64a636b4-e106-4968-8740-9938e9b2bcc8 {{(pid=98967) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 26 10:38:12.389388 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-2714945e-c2c5-4862-80bf-5fcaee63c385 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Successfully detached device vdb from instance 64a636b4-e106-4968-8740-9938e9b2bcc8 from the live domain config. Jun 26 10:38:12.396031 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:12.548395 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d4153812-a372-427d-823b-036cec02e3ea tempest-VolumesAssistedSnapshotsTest-85186532 tempest-VolumesAssistedSnapshotsTest-85186532-project-admin] Lock "5bc6474f-1a05-4e8a-9553-a5597c60728d" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 4.259s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:12.755639 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-c850b564-0a93-4ada-994c-8e6802855783 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:38:12.776967 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:12.943511 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-2714945e-c2c5-4862-80bf-5fcaee63c385 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Detected multiple connections on this host for volume: 243799f9-5b48-488a-9a05-c0ca1141a23b, skipping target disconnect. Jun 26 10:38:12.945342 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:13.109505 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe -F raw /opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d/disk" returned: 0 in 1.126s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:13.109980 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Created local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 26 10:38:13.110236 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Ensure instance console log exists: /opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d/console.log {{(pid=98967) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 26 10:38:13.110572 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:13.110795 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:13.110980 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:13.113921 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Start _get_guest_xml network_info=[{"id": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "address": "fa:16:3e:4c:ec:5e", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ae095e-5d", "ovs_interfaceid": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='da8ec837b7136a785122c94eafa8899e',container_format='bare',created_at=2026-06-26T10:37:42Z,direct_url=,disk_format='qcow2',id=3155480a-a06f-4039-8ee3-f855ef330399,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-674212499-shelved',owner='39600b204ad64a6db28676693c86dd70',properties=ImageMetaProps,protected=,size=53608448,status='active',tags=,updated_at=2026-06-26T10:37:50Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'image_id': 'a9b18127-6fee-4ed6-b364-a2d634ecb8b7'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de', 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '686999d0-6896-4156-a01d-0eb60aba41de', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attached', 'instance': '81a0f65d-2017-4275-aabe-88bc8c81225d', 'attached_at': '', 'detached_at': '', 'volume_id': '686999d0-6896-4156-a01d-0eb60aba41de', 'serial': '686999d0-6896-4156-a01d-0eb60aba41de'}, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'attachment_id': '7240d8b5-d112-4fb8-9345-c2f8dc0243c1', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:38:13.118527 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:13.122542 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:38:13.124272 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-674212499', uuid='81a0f65d-2017-4275-aabe-88bc8c81225d'), owner=OwnerMeta(userid='2a7c139c060e4c998d31cf957835db61', username='tempest-AttachVolumeShelveTestJSON-959960600-project-member', projectid='39600b204ad64a6db28676693c86dd70', projectname='tempest-AttachVolumeShelveTestJSON-959960600'), image=ImageMeta(id='3155480a-a06f-4039-8ee3-f855ef330399', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "address": "fa:16:3e:4c:ec:5e", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ae095e-5d", "ovs_interfaceid": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470293.1237226) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:38:13.125524 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:38:13.126135 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:38:13.127088 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:38:13.127312 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:38:13.128457 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:38:13.128903 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='da8ec837b7136a785122c94eafa8899e',container_format='bare',created_at=2026-06-26T10:37:42Z,direct_url=,disk_format='qcow2',id=3155480a-a06f-4039-8ee3-f855ef330399,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-674212499-shelved',owner='39600b204ad64a6db28676693c86dd70',properties=ImageMetaProps,protected=,size=53608448,status='active',tags=,updated_at=2026-06-26T10:37:50Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:38:13.129122 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:38:13.129260 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:38:13.129433 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:38:13.129553 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:38:13.129700 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:38:13.129903 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:38:13.130109 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:38:13.130262 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:38:13.130411 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:38:13.130571 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:38:13.130772 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lazy-loading 'vcpu_model' on Instance uuid 81a0f65d-2017-4275-aabe-88bc8c81225d {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:13.265280 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c850b564-0a93-4ada-994c-8e6802855783 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.750s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:13.296134 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Updating instance_info_cache with network_info: [{"id": "d8b51bcb-01d0-46b9-a5ff-b3335f560c00", "address": "fa:16:3e:1b:55:09", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b51bcb-01", "ovs_interfaceid": "d8b51bcb-01d0-46b9-a5ff-b3335f560c00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:38:13.360651 np0000003731 nova-compute[98967]: INFO nova.scheduler.client.report [None req-c850b564-0a93-4ada-994c-8e6802855783 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Deleted allocations for instance c43215aa-be15-4556-8162-bcd9793048c0 Jun 26 10:38:13.514358 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-2714945e-c2c5-4862-80bf-5fcaee63c385 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lazy-loading 'flavor' on Instance uuid 64a636b4-e106-4968-8740-9938e9b2bcc8 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:13.633369 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Object Instance<81a0f65d-2017-4275-aabe-88bc8c81225d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:38:13.643516 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Calling os-brick to attach iSCSI Volume {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 26 10:38:13.643808 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de', 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '686999d0-6896-4156-a01d-0eb60aba41de', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:38:13.643962 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:38:13.644327 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:38:13.644539 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de', 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '686999d0-6896-4156-a01d-0eb60aba41de', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 10:38:13.655946 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:38:13.657054 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:38:13.657826 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:38:13.658053 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:38:13.658443 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:38:13.658644 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:38:13.669904 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:38:13.669904 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:13.674325 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:38:13.674325 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:13.680843 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de] added Jun 26 10:38:13.680843 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:38:13.680843 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:38:13.680843 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:38:13.680843 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:38:13.680843 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:38:13.680843 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:13.681122 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:38:13.681292 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0232(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:38:13.681416 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:38:13.684622 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de] added Jun 26 10:38:13.684622 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:38:13.684622 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:38:13.684622 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:38:13.684622 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:38:13.684622 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:38:13.684622 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:13.684786 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:38:13.684998 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0263(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:38:13.685184 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:38:13.798479 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Releasing lock "refresh_cache-047061b2-340c-4cc9-899b-0744dad0081f" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:38:13.887703 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c09b640-bf92-4d6d-9697-a7b6890dc62a tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Acquiring lock "5bc6474f-1a05-4e8a-9553-a5597c60728d" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:13.887866 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c09b640-bf92-4d6d-9697-a7b6890dc62a tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Lock "5bc6474f-1a05-4e8a-9553-a5597c60728d" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:13.888326 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c09b640-bf92-4d6d-9697-a7b6890dc62a tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Acquiring lock "5bc6474f-1a05-4e8a-9553-a5597c60728d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:13.888326 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c09b640-bf92-4d6d-9697-a7b6890dc62a tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Lock "5bc6474f-1a05-4e8a-9553-a5597c60728d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:13.888326 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c09b640-bf92-4d6d-9697-a7b6890dc62a tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Lock "5bc6474f-1a05-4e8a-9553-a5597c60728d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:13.892675 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-7c09b640-bf92-4d6d-9697-a7b6890dc62a tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Terminating instance Jun 26 10:38:13.969761 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-70110fc2-d52d-44bd-a176-00d5e0cc7d3e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "212147b0-26de-42cd-b43d-057ec8d61c72" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 6.686s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:13.981762 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:14.256282 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:38:14.256508 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:38:14.256700 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:38:14.256888 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:38:14.257079 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:38:14.257272 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:38:14.257437 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:38:14.257620 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:38:14.257741 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98967) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 26 10:38:14.258122 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager.update_available_resource {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:38:14.378754 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c850b564-0a93-4ada-994c-8e6802855783 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Lock "c43215aa-be15-4556-8162-bcd9793048c0" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 8.006s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:14.393691 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-7c09b640-bf92-4d6d-9697-a7b6890dc62a tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Start destroying the instance on the hypervisor. {{(pid=98967) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 26 10:38:14.421606 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:14.424118 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:14.447355 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:14.450256 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:14.477112 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:14.520653 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2714945e-c2c5-4862-80bf-5fcaee63c385 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "64a636b4-e106-4968-8740-9938e9b2bcc8" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 3.250s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:14.683426 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:38:14.686357 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.40.100 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:38:14.696865 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.50.100 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:38:14.707502 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:14.716059 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:14.724031 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-565a872d-2433-4b59-80ba-2dcda9232a51 req-a8c4ab7a-633a-4e38-aea2-5c80f93567b4 service nova] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Received event network-vif-unplugged-6055bbc4-aeb1-4b68-a104-fd89f90067cf {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:14.724031 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-565a872d-2433-4b59-80ba-2dcda9232a51 req-a8c4ab7a-633a-4e38-aea2-5c80f93567b4 service nova] Acquiring lock "5bc6474f-1a05-4e8a-9553-a5597c60728d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:14.724031 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-565a872d-2433-4b59-80ba-2dcda9232a51 req-a8c4ab7a-633a-4e38-aea2-5c80f93567b4 service nova] Lock "5bc6474f-1a05-4e8a-9553-a5597c60728d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:14.724031 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-565a872d-2433-4b59-80ba-2dcda9232a51 req-a8c4ab7a-633a-4e38-aea2-5c80f93567b4 service nova] Lock "5bc6474f-1a05-4e8a-9553-a5597c60728d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:14.724031 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-565a872d-2433-4b59-80ba-2dcda9232a51 req-a8c4ab7a-633a-4e38-aea2-5c80f93567b4 service nova] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] No waiting events found dispatching network-vif-unplugged-6055bbc4-aeb1-4b68-a104-fd89f90067cf {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:14.724031 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-565a872d-2433-4b59-80ba-2dcda9232a51 req-a8c4ab7a-633a-4e38-aea2-5c80f93567b4 service nova] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Received event network-vif-unplugged-6055bbc4-aeb1-4b68-a104-fd89f90067cf for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:38:14.724031 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:14.739227 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:14.739227 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:14.739227 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:14.739227 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:14.739227 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:14.739227 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:14.739227 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:14.739227 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:14.739227 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:14.739227 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:14.739227 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:14.739227 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:14.739227 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:38:14.739673 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:14.739673 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:14.739673 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:14.739673 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:14.739673 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:14.739673 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:14.739673 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:14.739673 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:14.739673 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:14.739673 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:14.739673 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:14.739673 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:14.739673 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:38:14.746749 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:14.746749 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:14.746749 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:14.746749 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:14.746749 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:14.746749 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:14.746749 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:14.746749 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:14.746749 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:14.746749 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:14.746749 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:14.746749 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:14.746749 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:38:14.747162 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:14.747162 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:14.747162 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:14.747162 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:14.747162 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:14.747162 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:14.747162 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:14.747162 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:14.747162 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:14.747162 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:14.747162 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:14.747162 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:14.747162 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:38:14.749212 np0000003731 nova-compute[98967]: DEBUG nova.utils [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Queued Task(fn=>, remaining_delay=14.999798245999955 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:14.750297 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Instance destroyed successfully. Jun 26 10:38:14.750679 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-7c09b640-bf92-4d6d-9697-a7b6890dc62a tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Lazy-loading 'resources' on Instance uuid 5bc6474f-1a05-4e8a-9553-a5597c60728d {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:14.761747 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:14.762250 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:14.762334 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:14.762495 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Auditing locally available compute resources for np0000003731 (node: np0000003731) {{(pid=98967) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 26 10:38:14.795183 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de, portal: 192.168.40.100,3260] Jun 26 10:38:14.795183 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de, portal: 192.168.40.100,3260] successful. Jun 26 10:38:14.795183 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:14.810394 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:14.827361 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de, portal: 192.168.50.100,3260] Jun 26 10:38:14.827361 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de, portal: 192.168.50.100,3260] successful. Jun 26 10:38:14.827361 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:14.838291 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:14.838291 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:14.838291 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:14.838291 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:14.838291 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:14.838291 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:14.838291 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:14.838291 np0000003731 nova-compute[98967]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:38:14.838291 np0000003731 nova-compute[98967]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:38:14.838291 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:14.838291 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:14.838291 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:14.838291 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:14.838291 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:14.838291 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:38:14.838790 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:14.838790 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:14.838790 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:14.838790 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:14.838790 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:14.838790 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:14.838790 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:14.838790 np0000003731 nova-compute[98967]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:38:14.838790 np0000003731 nova-compute[98967]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:38:14.838790 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:14.838790 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:14.838790 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:14.838790 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:14.838790 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:14.838790 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:38:14.841465 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.182s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:38:14.841465 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Connected to 192.168.40.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:38:14.841465 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] HCTL ('15', '-', '-', 0) found on session 20 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:38:14.841465 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:38:14.841465 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:14.863466 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Searching for a device in session 20 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:38:14.863466 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '686999d0-6896-4156-a01d-0eb60aba41de', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:38:14.875288 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:14.875288 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:14.875288 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:14.875288 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:14.875288 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:14.875288 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:14.875288 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:14.875288 np0000003731 nova-compute[98967]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:38:14.875288 np0000003731 nova-compute[98967]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:38:14.875288 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:14.875288 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:14.875288 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:14.875288 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:14.875288 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:14.875288 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:38:14.875792 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:14.875792 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:14.875792 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:14.875792 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:14.875792 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:14.875792 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:14.875792 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:14.875792 np0000003731 nova-compute[98967]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:38:14.875792 np0000003731 nova-compute[98967]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:38:14.875792 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:14.875792 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:14.875792 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:14.875792 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:14.875792 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:14.875792 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:38:14.875792 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.217s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:38:14.876265 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Connected to 192.168.50.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:38:14.877601 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] HCTL ('16', '-', '-', 0) found on session 21 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:38:14.877747 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:38:14.892630 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Searching for a device in session 21 and hctl ['16', '*', '*', 0] yield: None {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:38:14.923116 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.001534444000071744 future=) was cancelled during its delay period, skipping {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:14.923472 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:14.923604 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=7.473748448999913 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:14.923761 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=7.4736051329998645 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:15.258191 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-7c09b640-bf92-4d6d-9697-a7b6890dc62a tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:36:53Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-VolumesAssistedSnapshotsTest-server-1386405030',display_name='tempest-VolumesAssistedSnapshotsTest-server-1386405030',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-volumesassistedsnapshotstest-server-1386405030',id=7,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEnHGWwEuXEhb1IzOgp8fDn85bj3sm3mK8KShUXLtm9TNgLS8Zo/JVq6sJuJKzUT1WkRlLE7Tnw+cZP4cweT/ZA/DmDNEjbD6ObFV3UAJh5f4VY6CfXeWw0bOU2RuINXtA==',key_name='tempest-keypair-1500016376',keypairs=,launch_index=0,launched_at=2026-06-26T10:37:14Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='f006893b34fb45e7bf33415299ffc934',ramdisk_id='',reservation_id='r-otdaw6r7',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-VolumesAssistedSnapshotsTest-736988545',owner_user_name='tempest-VolumesAssistedSnapshotsTest-736988545-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-26T10:37:15Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='93b18ad8fd1549ebbb429c95feb252b2',uuid=5bc6474f-1a05-4e8a-9553-a5597c60728d,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "6055bbc4-aeb1-4b68-a104-fd89f90067cf", "address": "fa:16:3e:3a:ec:e4", "network": {"id": "6a21b76b-0047-4efe-ae27-7a07d157c13a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1520786875-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f006893b34fb45e7bf33415299ffc934", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6055bbc4-ae", "ovs_interfaceid": "6055bbc4-aeb1-4b68-a104-fd89f90067cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 26 10:38:15.258191 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-7c09b640-bf92-4d6d-9697-a7b6890dc62a tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Converting VIF {"id": "6055bbc4-aeb1-4b68-a104-fd89f90067cf", "address": "fa:16:3e:3a:ec:e4", "network": {"id": "6a21b76b-0047-4efe-ae27-7a07d157c13a", "bridge": "br-int", "label": "tempest-VolumesAssistedSnapshotsTest-1520786875-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.15", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "f006893b34fb45e7bf33415299ffc934", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap6055bbc4-ae", "ovs_interfaceid": "6055bbc4-aeb1-4b68-a104-fd89f90067cf", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:38:15.258191 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-7c09b640-bf92-4d6d-9697-a7b6890dc62a tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:3a:ec:e4,bridge_name='br-int',has_traffic_filtering=True,id=6055bbc4-aeb1-4b68-a104-fd89f90067cf,network=Network(6a21b76b-0047-4efe-ae27-7a07d157c13a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6055bbc4-ae') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:38:15.258191 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-7c09b640-bf92-4d6d-9697-a7b6890dc62a tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:ec:e4,bridge_name='br-int',has_traffic_filtering=True,id=6055bbc4-aeb1-4b68-a104-fd89f90067cf,network=Network(6a21b76b-0047-4efe-ae27-7a07d157c13a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6055bbc4-ae') {{(pid=98967) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 26 10:38:15.258191 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:15.258191 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap6055bbc4-ae, bridge=br-int, if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:15.259166 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:15.259867 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:15.260737 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:15.273178 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:15.273178 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=debba016-fdcc-4a2b-9d15-ebac8a34221b) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:15.273178 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:15.274787 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:15.274787 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:15.277709 np0000003731 nova-compute[98967]: INFO os_vif [None req-7c09b640-bf92-4d6d-9697-a7b6890dc62a tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:3a:ec:e4,bridge_name='br-int',has_traffic_filtering=True,id=6055bbc4-aeb1-4b68-a104-fd89f90067cf,network=Network(6a21b76b-0047-4efe-ae27-7a07d157c13a),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap6055bbc4-ae') Jun 26 10:38:15.278096 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-7c09b640-bf92-4d6d-9697-a7b6890dc62a tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Deleting instance files /opt/stack/data/nova/instances/5bc6474f-1a05-4e8a-9553-a5597c60728d_del Jun 26 10:38:15.281830 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-7c09b640-bf92-4d6d-9697-a7b6890dc62a tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Deletion of /opt/stack/data/nova/instances/5bc6474f-1a05-4e8a-9553-a5597c60728d_del complete Jun 26 10:38:15.452175 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:15.460690 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:15.489468 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:15.629532 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:15.636967 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:15.703055 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0c1180ac-2832-434a-b296-bd6e32acf6f8 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "4b4a4a7e-d584-427e-91d2-7d9e710ea2a3" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:15.703302 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0c1180ac-2832-434a-b296-bd6e32acf6f8 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "4b4a4a7e-d584-427e-91d2-7d9e710ea2a3" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:15.771815 np0000003731 nova-compute[98967]: DEBUG nova.utils [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Queued Task(fn=>, remaining_delay=14.999759514000061 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:15.773270 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Instance destroyed successfully. Jun 26 10:38:15.773685 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'numa_topology' on Instance uuid 047061b2-340c-4cc9-899b-0744dad0081f {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:15.785905 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-7c09b640-bf92-4d6d-9697-a7b6890dc62a tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Took 1.39 seconds to destroy the instance on the hypervisor. Jun 26 10:38:15.786938 np0000003731 nova-compute[98967]: DEBUG oslo.service.backend._common.loopingcall [None req-7c09b640-bf92-4d6d-9697-a7b6890dc62a tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98967) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 26 10:38:15.787477 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [-] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Deallocating network for instance {{(pid=98967) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 26 10:38:15.787617 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [-] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] deallocate_for_instance() {{(pid=98967) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 26 10:38:15.787842 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:15.804611 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98967) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 26 10:38:15.806047 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:15.806191 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:15.806995 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk.rescue --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:15.893817 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Searching for a device in session 21 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:38:15.894093 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '686999d0-6896-4156-a01d-0eb60aba41de', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:38:15.898896 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk.rescue --force-share --output=json" returned: 0 in 0.092s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:15.899401 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk.rescue --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:15.915231 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:15.975754 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk.rescue --force-share --output=json" returned: 0 in 0.076s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:15.976252 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:16.059522 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-eeacf2e4-9199-4806-9ee4-63425e703761 req-ade7fc61-3ee1-43a2-baac-b15e641613f3 service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Received event network-vif-unplugged-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:16.059795 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-eeacf2e4-9199-4806-9ee4-63425e703761 req-ade7fc61-3ee1-43a2-baac-b15e641613f3 service nova] Acquiring lock "047061b2-340c-4cc9-899b-0744dad0081f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:16.060014 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-eeacf2e4-9199-4806-9ee4-63425e703761 req-ade7fc61-3ee1-43a2-baac-b15e641613f3 service nova] Lock "047061b2-340c-4cc9-899b-0744dad0081f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:16.060137 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-eeacf2e4-9199-4806-9ee4-63425e703761 req-ade7fc61-3ee1-43a2-baac-b15e641613f3 service nova] Lock "047061b2-340c-4cc9-899b-0744dad0081f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:16.061299 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-eeacf2e4-9199-4806-9ee4-63425e703761 req-ade7fc61-3ee1-43a2-baac-b15e641613f3 service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] No waiting events found dispatching network-vif-unplugged-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:16.061431 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-eeacf2e4-9199-4806-9ee4-63425e703761 req-ade7fc61-3ee1-43a2-baac-b15e641613f3 service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Received unexpected event network-vif-unplugged-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 for instance with vm_state active and task_state rescuing. Jun 26 10:38:16.062622 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk --force-share --output=json" returned: 0 in 0.086s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:16.063100 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:16.146881 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk --force-share --output=json" returned: 0 in 0.083s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:16.149864 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64a636b4-e106-4968-8740-9938e9b2bcc8/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:16.206434 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-0c1180ac-2832-434a-b296-bd6e32acf6f8 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Detaching volume 47f52d31-fbea-432a-bdb6-e4f813146c47 Jun 26 10:38:16.246905 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64a636b4-e106-4968-8740-9938e9b2bcc8/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:16.247286 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64a636b4-e106-4968-8740-9938e9b2bcc8/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:16.275894 np0000003731 nova-compute[98967]: INFO nova.virt.block_device [None req-0c1180ac-2832-434a-b296-bd6e32acf6f8 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3] Attempting to driver detach volume 47f52d31-fbea-432a-bdb6-e4f813146c47 from mountpoint /dev/vdb Jun 26 10:38:16.281848 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Attempting rescue Jun 26 10:38:16.287056 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98967) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4640}} Jun 26 10:38:16.292833 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0c1180ac-2832-434a-b296-bd6e32acf6f8 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Found disk vdb by alias ua-47f52d31-fbea-432a-bdb6-e4f813146c47 {{(pid=98967) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 26 10:38:16.294668 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0c1180ac-2832-434a-b296-bd6e32acf6f8 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Found disk vdb by alias ua-47f52d31-fbea-432a-bdb6-e4f813146c47 {{(pid=98967) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 26 10:38:16.295177 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0c1180ac-2832-434a-b296-bd6e32acf6f8 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Attempting to detach device vdb from instance 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3 from the persistent domain config. {{(pid=98967) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 26 10:38:16.295692 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-0c1180ac-2832-434a-b296-bd6e32acf6f8 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] detach device xml: Jun 26 10:38:16.295692 np0000003731 nova-compute[98967]: Jun 26 10:38:16.295692 np0000003731 nova-compute[98967]: Jun 26 10:38:16.295692 np0000003731 nova-compute[98967]: Jun 26 10:38:16.295692 np0000003731 nova-compute[98967]: Jun 26 10:38:16.295692 np0000003731 nova-compute[98967]: 47f52d31-fbea-432a-bdb6-e4f813146c47 Jun 26 10:38:16.295692 np0000003731 nova-compute[98967]: Jun 26 10:38:16.295692 np0000003731 nova-compute[98967]:
Jun 26 10:38:16.295692 np0000003731 nova-compute[98967]: Jun 26 10:38:16.295692 np0000003731 nova-compute[98967]: {{(pid=98967) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 26 10:38:16.297958 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Instance directory exists: not creating {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}} Jun 26 10:38:16.297958 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Creating image(s) Jun 26 10:38:16.297958 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "/opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:16.297958 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "/opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:16.297958 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "/opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:16.298251 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'trusted_certs' on Instance uuid 047061b2-340c-4cc9-899b-0744dad0081f {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:16.326692 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Detaching volume 243799f9-5b48-488a-9a05-c0ca1141a23b Jun 26 10:38:16.330848 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-0c1180ac-2832-434a-b296-bd6e32acf6f8 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Successfully detached device vdb from instance 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3 from the persistent domain config. Jun 26 10:38:16.331106 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0c1180ac-2832-434a-b296-bd6e32acf6f8 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] (1/8): Attempting to detach device vdb with device alias ua-47f52d31-fbea-432a-bdb6-e4f813146c47 from instance 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3 from the live domain config. {{(pid=98967) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 26 10:38:16.331458 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-0c1180ac-2832-434a-b296-bd6e32acf6f8 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] detach device xml: Jun 26 10:38:16.331458 np0000003731 nova-compute[98967]: Jun 26 10:38:16.331458 np0000003731 nova-compute[98967]: Jun 26 10:38:16.331458 np0000003731 nova-compute[98967]: Jun 26 10:38:16.331458 np0000003731 nova-compute[98967]: Jun 26 10:38:16.331458 np0000003731 nova-compute[98967]: 47f52d31-fbea-432a-bdb6-e4f813146c47 Jun 26 10:38:16.331458 np0000003731 nova-compute[98967]: Jun 26 10:38:16.331458 np0000003731 nova-compute[98967]:
Jun 26 10:38:16.331458 np0000003731 nova-compute[98967]: Jun 26 10:38:16.331458 np0000003731 nova-compute[98967]: {{(pid=98967) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 26 10:38:16.336552 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/64a636b4-e106-4968-8740-9938e9b2bcc8/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:16.338587 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Error from libvirt while getting description of instance-00000007: [Error Code 42] Domain not found: no domain with matching uuid '5bc6474f-1a05-4e8a-9553-a5597c60728d' (instance-00000007): libvirt.libvirtError: Domain not found: no domain with matching uuid '5bc6474f-1a05-4e8a-9553-a5597c60728d' (instance-00000007) Jun 26 10:38:16.357379 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b93909a-db10-4b65-b5a7-0aa3f0a47da7/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:16.417449 np0000003731 nova-compute[98967]: INFO nova.virt.block_device [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Attempting to driver detach volume 243799f9-5b48-488a-9a05-c0ca1141a23b from mountpoint /dev/vdb Jun 26 10:38:16.430781 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Found disk vdb by alias ua-243799f9-5b48-488a-9a05-c0ca1141a23b {{(pid=98967) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 26 10:38:16.433097 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Found disk vdb by alias ua-243799f9-5b48-488a-9a05-c0ca1141a23b {{(pid=98967) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 26 10:38:16.433220 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Attempting to detach device vdb from instance 0b93909a-db10-4b65-b5a7-0aa3f0a47da7 from the persistent domain config. {{(pid=98967) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 26 10:38:16.433363 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] detach device xml: Jun 26 10:38:16.433363 np0000003731 nova-compute[98967]: Jun 26 10:38:16.433363 np0000003731 nova-compute[98967]: Jun 26 10:38:16.433363 np0000003731 nova-compute[98967]: Jun 26 10:38:16.433363 np0000003731 nova-compute[98967]: Jun 26 10:38:16.433363 np0000003731 nova-compute[98967]: 243799f9-5b48-488a-9a05-c0ca1141a23b Jun 26 10:38:16.433363 np0000003731 nova-compute[98967]: Jun 26 10:38:16.433363 np0000003731 nova-compute[98967]:
Jun 26 10:38:16.433363 np0000003731 nova-compute[98967]: Jun 26 10:38:16.433363 np0000003731 nova-compute[98967]: {{(pid=98967) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 26 10:38:16.446391 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Successfully detached device vdb from instance 0b93909a-db10-4b65-b5a7-0aa3f0a47da7 from the persistent domain config. Jun 26 10:38:16.446585 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] (1/8): Attempting to detach device vdb with device alias ua-243799f9-5b48-488a-9a05-c0ca1141a23b from instance 0b93909a-db10-4b65-b5a7-0aa3f0a47da7 from the live domain config. {{(pid=98967) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 26 10:38:16.446854 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] detach device xml: Jun 26 10:38:16.446854 np0000003731 nova-compute[98967]: Jun 26 10:38:16.446854 np0000003731 nova-compute[98967]: Jun 26 10:38:16.446854 np0000003731 nova-compute[98967]: Jun 26 10:38:16.446854 np0000003731 nova-compute[98967]: Jun 26 10:38:16.446854 np0000003731 nova-compute[98967]: 243799f9-5b48-488a-9a05-c0ca1141a23b Jun 26 10:38:16.446854 np0000003731 nova-compute[98967]: Jun 26 10:38:16.446854 np0000003731 nova-compute[98967]:
Jun 26 10:38:16.446854 np0000003731 nova-compute[98967]: Jun 26 10:38:16.446854 np0000003731 nova-compute[98967]: {{(pid=98967) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 26 10:38:16.458497 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b93909a-db10-4b65-b5a7-0aa3f0a47da7/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:16.459187 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b93909a-db10-4b65-b5a7-0aa3f0a47da7/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:16.547140 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0b93909a-db10-4b65-b5a7-0aa3f0a47da7/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:16.549678 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] skipping disk /dev/dm-9 (vdb) as it is a volume {{(pid=98967) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 26 10:38:16.555613 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98967) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 26 10:38:16.555734 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98967) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 26 10:38:16.555837 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] skipping disk /dev/dm-7 (vdc) as it is a volume {{(pid=98967) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 26 10:38:16.562283 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212147b0-26de-42cd-b43d-057ec8d61c72/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:16.588064 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:16.653588 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212147b0-26de-42cd-b43d-057ec8d61c72/disk --force-share --output=json" returned: 0 in 0.091s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:16.654221 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212147b0-26de-42cd-b43d-057ec8d61c72/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:16.685147 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Found WWN 330000000cb08bae0 for multipath device dm-8 {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 26 10:38:16.686060 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:38:16.686397 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '330000000cb08bae0', 'path': '/dev/dm-8', 'multipath_id': '330000000cb08bae0'} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:38:16.686642 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000cb08bae0', 'path': '/dev/dm-8', 'multipath_id': '330000000cb08bae0'} {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 26 10:38:16.751142 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212147b0-26de-42cd-b43d-057ec8d61c72/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:16.752283 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] skipping disk /dev/dm-10 (vdb) as it is a volume {{(pid=98967) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 26 10:38:16.755494 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4a4a7e-d584-427e-91d2-7d9e710ea2a3/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:16.802775 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-96ef333a-3a9f-4bd0-abb6-e6e12e06de4a req-05b9a068-2bf7-4a2d-a40b-ca2c93ad6e54 service nova] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Received event network-vif-unplugged-6055bbc4-aeb1-4b68-a104-fd89f90067cf {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:16.803510 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-96ef333a-3a9f-4bd0-abb6-e6e12e06de4a req-05b9a068-2bf7-4a2d-a40b-ca2c93ad6e54 service nova] Acquiring lock "5bc6474f-1a05-4e8a-9553-a5597c60728d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:16.804861 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-96ef333a-3a9f-4bd0-abb6-e6e12e06de4a req-05b9a068-2bf7-4a2d-a40b-ca2c93ad6e54 service nova] Lock "5bc6474f-1a05-4e8a-9553-a5597c60728d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:16.805110 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-96ef333a-3a9f-4bd0-abb6-e6e12e06de4a req-05b9a068-2bf7-4a2d-a40b-ca2c93ad6e54 service nova] Lock "5bc6474f-1a05-4e8a-9553-a5597c60728d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.002s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:16.805650 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-96ef333a-3a9f-4bd0-abb6-e6e12e06de4a req-05b9a068-2bf7-4a2d-a40b-ca2c93ad6e54 service nova] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] No waiting events found dispatching network-vif-unplugged-6055bbc4-aeb1-4b68-a104-fd89f90067cf {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:16.805815 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-96ef333a-3a9f-4bd0-abb6-e6e12e06de4a req-05b9a068-2bf7-4a2d-a40b-ca2c93ad6e54 service nova] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Received event network-vif-unplugged-6055bbc4-aeb1-4b68-a104-fd89f90067cf for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:38:16.806488 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Object Instance<047061b2-340c-4cc9-899b-0744dad0081f> lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:38:16.807293 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:16.811932 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:16.814914 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:16.815512 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:16.815825 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:16.828555 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:16.830350 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:16.843152 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4a4a7e-d584-427e-91d2-7d9e710ea2a3/disk --force-share --output=json" returned: 0 in 0.087s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:16.843508 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4a4a7e-d584-427e-91d2-7d9e710ea2a3/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:16.917920 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.087s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:16.917920 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk.rescue {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:16.935164 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-0c1180ac-2832-434a-b296-bd6e32acf6f8 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-47f52d31-fbea-432a-bdb6-e4f813146c47 for instance 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3 {{(pid=98967) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 26 10:38:16.936285 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Received event ua-47f52d31-fbea-432a-bdb6-e4f813146c47> from libvirt while the driver is waiting for it; dispatched. {{(pid=98967) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 26 10:38:16.940693 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-0c1180ac-2832-434a-b296-bd6e32acf6f8 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Successfully detached device vdb from instance 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3 from the live domain config. Jun 26 10:38:16.949274 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4a4a7e-d584-427e-91d2-7d9e710ea2a3/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:16.949914 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] skipping disk /dev/dm-10 (vdb) as it is a volume {{(pid=98967) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 26 10:38:16.954222 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:16.975127 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk.rescue" returned: 0 in 0.057s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:16.975604 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.160s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:16.976123 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'migration_context' on Instance uuid 047061b2-340c-4cc9-899b-0744dad0081f {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:17.050500 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:17.052696 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:17.146104 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:17.148898 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:38:17.149959 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:17.180074 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "env LANG=C uptime" returned: 0 in 0.030s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:17.180577 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Hypervisor/Node resource view: name=np0000003731 free_ram=50146MB free_disk=74.1836929321289GB free_vcpus=8 pci_devices=[{"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98967) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 26 10:38:17.180717 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:17.180984 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:17.198971 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-26T10:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-674212499',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-attachvolumeshelvetestjson-server-674212499',id=2,image_ref='3155480a-a06f-4039-8ee3-f855ef330399',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-313994434',keypairs=,launch_index=0,launched_at=2026-06-26T10:36:59Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='39600b204ad64a6db28676693c86dd70',ramdisk_id='',reservation_id='r-691lr44p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-959960600',owner_user_name='tempest-AttachVolumeShelveTestJSON-959960600-project-member',shelved_at='2026-06-26T10:37:50.290933',shelved_host='np0000003731',shelved_image_id='3155480a-a06f-4039-8ee3-f855ef330399'},tags=,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a7c139c060e4c998d31cf957835db61',uuid=81a0f65d-2017-4275-aabe-88bc8c81225d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "address": "fa:16:3e:4c:ec:5e", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ae095e-5d", "ovs_interfaceid": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:38:17.199255 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Converting VIF {"id": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "address": "fa:16:3e:4c:ec:5e", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ae095e-5d", "ovs_interfaceid": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:38:17.199863 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:ec:5e,bridge_name='br-int',has_traffic_filtering=True,id=b6ae095e-5da6-45dd-95bd-47cf007120c3,network=Network(79bcd519-98c3-4905-a83f-c080654f2cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6ae095e-5d') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:38:17.201310 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lazy-loading 'pci_devices' on Instance uuid 81a0f65d-2017-4275-aabe-88bc8c81225d {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:17.366238 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [-] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:38:17.396191 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:17.482879 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Object Instance<047061b2-340c-4cc9-899b-0744dad0081f> lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:38:17.483201 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Created local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 26 10:38:17.483845 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Start _get_guest_xml network_info=[{"id": "d8b51bcb-01d0-46b9-a5ff-b3335f560c00", "address": "fa:16:3e:1b:55:09", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "vif_mac": "fa:16:3e:1b:55:09"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b51bcb-01", "ovs_interfaceid": "d8b51bcb-01d0-46b9-a5ff-b3335f560c00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=) rescue={'image_id': 'a9b18127-6fee-4ed6-b364-a2d634ecb8b7', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:38:17.484085 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'resources' on Instance uuid 047061b2-340c-4cc9-899b-0744dad0081f {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:17.492626 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-0c1180ac-2832-434a-b296-bd6e32acf6f8 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Detected multiple connections on this host for volume: 47f52d31-fbea-432a-bdb6-e4f813146c47, skipping target disconnect. Jun 26 10:38:17.704121 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Object Instance<81a0f65d-2017-4275-aabe-88bc8c81225d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] End _get_guest_xml xml= Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: 81a0f65d-2017-4275-aabe-88bc8c81225d Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: instance-00000002 Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: 196608 Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: tempest-AttachVolumeShelveTestJSON-server-674212499 Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: 2026-06-26 10:38:13 Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: 192 Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: 0 Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: 0 Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: True Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: bare Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: 0 Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: ide Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: virtio Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: pc Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: virtio Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: virtio Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: virtio Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: tempest-AttachVolumeShelveTestJSON-959960600-project-member Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: tempest-AttachVolumeShelveTestJSON-959960600 Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: 81a0f65d-2017-4275-aabe-88bc8c81225d Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: 81a0f65d-2017-4275-aabe-88bc8c81225d Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: hvm Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: 128 Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: 686999d0-6896-4156-a01d-0eb60aba41de Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: Jun 26 10:38:17.705892 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:38:17.708634 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Preparing to wait for external event network-vif-plugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:38:17.708634 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:17.708634 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:17.708634 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:17.708634 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-26T10:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-674212499',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-attachvolumeshelvetestjson-server-674212499',id=2,image_ref='3155480a-a06f-4039-8ee3-f855ef330399',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-313994434',keypairs=,launch_index=0,launched_at=2026-06-26T10:36:59Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='39600b204ad64a6db28676693c86dd70',ramdisk_id='',reservation_id='r-691lr44p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-959960600',owner_user_name='tempest-AttachVolumeShelveTestJSON-959960600-project-member',shelved_at='2026-06-26T10:37:50.290933',shelved_host='np0000003731',shelved_image_id='3155480a-a06f-4039-8ee3-f855ef330399'},tags=,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:59Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a7c139c060e4c998d31cf957835db61',uuid=81a0f65d-2017-4275-aabe-88bc8c81225d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "address": "fa:16:3e:4c:ec:5e", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ae095e-5d", "ovs_interfaceid": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:38:17.708634 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Converting VIF {"id": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "address": "fa:16:3e:4c:ec:5e", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ae095e-5d", "ovs_interfaceid": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:38:17.712653 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:ec:5e,bridge_name='br-int',has_traffic_filtering=True,id=b6ae095e-5da6-45dd-95bd-47cf007120c3,network=Network(79bcd519-98c3-4905-a83f-c080654f2cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6ae095e-5d') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:38:17.713054 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:ec:5e,bridge_name='br-int',has_traffic_filtering=True,id=b6ae095e-5da6-45dd-95bd-47cf007120c3,network=Network(79bcd519-98c3-4905-a83f-c080654f2cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6ae095e-5d') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:38:17.713473 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:17.713743 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:17.714018 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:38:17.715446 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:17.715665 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '6dd0ced6-2975-5adc-8e02-38dd350350b7', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:17.717394 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:17.718290 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:17.723347 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:17.725700 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:17.725910 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb6ae095e-5d, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:17.726302 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb6ae095e-5d, col_values=(('qos', UUID('ea233dfb-b5e3-46fd-a848-156a2ba34d41')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:17.726484 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb6ae095e-5d, col_values=(('external_ids', {'iface-id': 'b6ae095e-5da6-45dd-95bd-47cf007120c3', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:4c:ec:5e', 'vm-uuid': '81a0f65d-2017-4275-aabe-88bc8c81225d'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:17.727545 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:17.730463 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:17.742490 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:17.750879 np0000003731 nova-compute[98967]: INFO os_vif [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:ec:5e,bridge_name='br-int',has_traffic_filtering=True,id=b6ae095e-5da6-45dd-95bd-47cf007120c3,network=Network(79bcd519-98c3-4905-a83f-c080654f2cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6ae095e-5d') Jun 26 10:38:17.868296 np0000003731 nova-compute[98967]: INFO nova.compute.manager [-] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Took 2.08 seconds to deallocate network for instance. Jun 26 10:38:17.987167 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Object Instance<047061b2-340c-4cc9-899b-0744dad0081f> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:38:17.989026 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:38:17.990248 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-464264811', uuid='047061b2-340c-4cc9-899b-0744dad0081f'), owner=OwnerMeta(userid='04176251e13046eb8cfc1908246d4d9d', username='tempest-ServerRescueNegativeTestJSON-1439990304-project-member', projectid='58a58b94e5ec406182da9117e14aa789', projectname='tempest-ServerRescueNegativeTestJSON-1439990304'), image=ImageMeta(id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "d8b51bcb-01d0-46b9-a5ff-b3335f560c00", "address": "fa:16:3e:1b:55:09", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "vif_mac": "fa:16:3e:1b:55:09"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b51bcb-01", "ovs_interfaceid": "d8b51bcb-01d0-46b9-a5ff-b3335f560c00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470297.989863) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:38:17.991206 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:38:17.991555 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:38:17.992567 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:38:17.992732 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:38:17.993564 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:38:17.993866 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:38:17.993983 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:38:17.994109 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:38:17.994220 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:38:17.994287 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:38:17.994377 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:38:17.994515 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:38:17.994597 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:38:17.994695 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:38:17.994786 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:38:17.994962 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:38:17.995142 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'vcpu_model' on Instance uuid 047061b2-340c-4cc9-899b-0744dad0081f {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:18.079519 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-0c1180ac-2832-434a-b296-bd6e32acf6f8 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lazy-loading 'flavor' on Instance uuid 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:18.176845 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-9de5b859-9e45-42eb-88ec-3c5e017d0b9b req-64a9f711-298a-4eb8-8336-8ef9fa5cf5a0 service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Received event network-vif-unplugged-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:18.181513 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-9de5b859-9e45-42eb-88ec-3c5e017d0b9b req-64a9f711-298a-4eb8-8336-8ef9fa5cf5a0 service nova] Acquiring lock "047061b2-340c-4cc9-899b-0744dad0081f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:18.181708 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-9de5b859-9e45-42eb-88ec-3c5e017d0b9b req-64a9f711-298a-4eb8-8336-8ef9fa5cf5a0 service nova] Lock "047061b2-340c-4cc9-899b-0744dad0081f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:18.181846 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-9de5b859-9e45-42eb-88ec-3c5e017d0b9b req-64a9f711-298a-4eb8-8336-8ef9fa5cf5a0 service nova] Lock "047061b2-340c-4cc9-899b-0744dad0081f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:18.182038 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-9de5b859-9e45-42eb-88ec-3c5e017d0b9b req-64a9f711-298a-4eb8-8336-8ef9fa5cf5a0 service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] No waiting events found dispatching network-vif-unplugged-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:18.182203 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-9de5b859-9e45-42eb-88ec-3c5e017d0b9b req-64a9f711-298a-4eb8-8336-8ef9fa5cf5a0 service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Received unexpected event network-vif-unplugged-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 for instance with vm_state active and task_state rescuing. Jun 26 10:38:18.182355 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-9de5b859-9e45-42eb-88ec-3c5e017d0b9b req-64a9f711-298a-4eb8-8336-8ef9fa5cf5a0 service nova] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Received event network-vif-deleted-6055bbc4-aeb1-4b68-a104-fd89f90067cf {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:18.204724 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Received event ua-243799f9-5b48-488a-9a05-c0ca1141a23b> from libvirt while the driver is waiting for it; dispatched. {{(pid=98967) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 26 10:38:18.205249 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-243799f9-5b48-488a-9a05-c0ca1141a23b for instance 0b93909a-db10-4b65-b5a7-0aa3f0a47da7 {{(pid=98967) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 26 10:38:18.215061 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Successfully detached device vdb from instance 0b93909a-db10-4b65-b5a7-0aa3f0a47da7 from the live domain config. Jun 26 10:38:18.271207 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance d26dc4db-d71c-43b9-811a-d39b111be119 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:38:18.271207 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance 0b93909a-db10-4b65-b5a7-0aa3f0a47da7 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:38:18.271207 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance 64a636b4-e106-4968-8740-9938e9b2bcc8 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:38:18.271207 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance 5bc6474f-1a05-4e8a-9553-a5597c60728d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:38:18.271207 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance a686feac-bebe-47c8-a3c8-f3c2260ca7f5 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:38:18.271207 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:38:18.271207 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance 212147b0-26de-42cd-b43d-057ec8d61c72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:38:18.271207 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance 047061b2-340c-4cc9-899b-0744dad0081f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:38:18.271207 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance 25b12be8-e92b-4705-b668-05cfecaf66b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:38:18.271207 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance 81a0f65d-2017-4275-aabe-88bc8c81225d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:38:18.271207 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Total usable vcpus: 16, total allocated vcpus: 10 {{(pid=98967) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 26 10:38:18.271207 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Final resource view: name=np0000003731 phys_ram=64301MB used_ram=2432MB phys_disk=95GB used_disk=8GB total_vcpus=16 used_vcpus=10 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 10:38:17 up 27 min, 2 users, load average: 10.41, 5.28, 2.44\n', 'num_instances': '10', 'num_vm_active': '8', 'num_task_None': '7', 'num_os_type_None': '10', 'num_proj_49c2798faed447838b6c87f6d15cce66': '3', 'io_workload': '1', 'num_proj_b4242a2b73cf4564ac8f9f2cb9c7a7bf': '2', 'num_proj_93df6885279b4537969fc0d1beb9f198': '1', 'num_task_rescuing': '1', 'num_proj_58a58b94e5ec406182da9117e14aa789': '2', 'num_vm_rescued': '1', 'num_vm_shelved_offloaded': '1', 'num_task_spawning': '1', 'num_proj_39600b204ad64a6db28676693c86dd70': '1', 'num_task_deleting': '1', 'num_proj_f006893b34fb45e7bf33415299ffc934': '1'} {{(pid=98967) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 26 10:38:18.303723 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] calling os-brick to detach iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 26 10:38:18.304176 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b', 'iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '243799f9-5b48-488a-9a05-c0ca1141a23b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, None), 'kwargs': {'force': False}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:38:18.304456 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:38:18.304889 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:38:18.305378 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b', 'iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '243799f9-5b48-488a-9a05-c0ca1141a23b', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 10:38:18.305856 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b', 0)] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 10:38:18.342271 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:18.342271 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:18.342271 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:18.342271 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:18.342271 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:18.342271 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:18.342271 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:18.342271 np0000003731 nova-compute[98967]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:38:18.342271 np0000003731 nova-compute[98967]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:38:18.342271 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:18.342271 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:18.342271 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:18.342271 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:18.342271 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:18.342271 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:38:18.342853 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:18.342853 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:18.342853 np0000003731 nova-compute[98967]: tcp: [14] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:18.342853 np0000003731 nova-compute[98967]: tcp: [15] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b (non-flash) Jun 26 10:38:18.342853 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:18.342853 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:18.342853 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:18.342853 np0000003731 nova-compute[98967]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:38:18.342853 np0000003731 nova-compute[98967]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:38:18.342853 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:18.342853 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:18.342853 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:18.342853 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:18.342853 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:18.342853 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:38:18.342853 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b', '14'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b', '15'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47', '16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '2'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020', '7'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77', '9')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 10:38:18.342853 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b', '14')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:38:18.344139 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b', '15')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:38:18.345330 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Resulting device map defaultdict(. at 0x75f0704f5da0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b'): ({'sdl'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b'): ({'sdm'}, set())}) {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 10:38:18.345553 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Removing multipathed devices sdm, sdl {{(pid=98967) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 10:38:18.345798 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Flush multipath device 3300000001309e66f {{(pid=98967) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 26 10:38:18.373565 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c09b640-bf92-4d6d-9697-a7b6890dc62a tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:18.383346 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Remove SCSI device /dev/sdm with /sys/block/sdm/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:38:18.433972 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Remove SCSI device /dev/sdl with /sys/block/sdl/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:38:18.494138 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Checking to see if SCSI volumes sdm, sdl have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 10:38:18.494138 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] SCSI volumes sdm, sdl have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 10:38:18.495654 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Checking to see if device paths {'sdm', 'sdl'} are still under multipathd monitoring {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 10:38:18.508375 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Object Instance<047061b2-340c-4cc9-899b-0744dad0081f> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:38:18.508375 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Device paths {'sdm', 'sdl'} have been removed from multipathd monitoring. {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 10:38:18.508375 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b')] {{(pid=98967) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 10:38:18.520220 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:37:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-464264811',display_name='tempest-ServerRescueNegativeTestJSON-server-464264811',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-serverrescuenegativetestjson-server-464264811',id=12,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-26T10:37:52Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='58a58b94e5ec406182da9117e14aa789',ramdisk_id='',reservation_id='r-or2m3uoy',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1439990304',owner_user_name='tempest-ServerRescueNegativeTestJSON-1439990304-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:37:52Z,user_data=None,user_id='04176251e13046eb8cfc1908246d4d9d',uuid=047061b2-340c-4cc9-899b-0744dad0081f,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "d8b51bcb-01d0-46b9-a5ff-b3335f560c00", "address": "fa:16:3e:1b:55:09", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "vif_mac": "fa:16:3e:1b:55:09"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b51bcb-01", "ovs_interfaceid": "d8b51bcb-01d0-46b9-a5ff-b3335f560c00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:38:18.524367 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Converting VIF {"id": "d8b51bcb-01d0-46b9-a5ff-b3335f560c00", "address": "fa:16:3e:1b:55:09", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "vif_mac": "fa:16:3e:1b:55:09"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b51bcb-01", "ovs_interfaceid": "d8b51bcb-01d0-46b9-a5ff-b3335f560c00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:38:18.524367 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:1b:55:09,bridge_name='br-int',has_traffic_filtering=True,id=d8b51bcb-01d0-46b9-a5ff-b3335f560c00,network=Network(d50baa85-72ef-4bb3-9676-e629d583d3a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapd8b51bcb-01') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:38:18.524367 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:18.524367 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'pci_devices' on Instance uuid 047061b2-340c-4cc9-899b-0744dad0081f {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:18.570151 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 14, target: iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b, portal: 192.168.40.100,3260] Jun 26 10:38:18.570151 np0000003731 nova-compute[98967]: Logout of [sid: 14, target: iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b, portal: 192.168.40.100,3260] successful. Jun 26 10:38:18.570151 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:18.599413 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:18.619883 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:18.661409 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 15, target: iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b, portal: 192.168.50.100,3260] Jun 26 10:38:18.661409 np0000003731 nova-compute[98967]: Logout of [sid: 15, target: iqn.2023-03.storpool.com:os--volume-243799f9-5b48-488a-9a05-c0ca1141a23b, portal: 192.168.50.100,3260] successful. Jun 26 10:38:18.661409 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:18.682732 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:18.683111 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.378s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:38:18.683319 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] <== disconnect_volume: return (378ms) None {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:38:18.683487 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Disconnected iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 26 10:38:18.914731 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:38:18.915001 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:38:19.025336 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Object Instance<047061b2-340c-4cc9-899b-0744dad0081f> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] End _get_guest_xml xml= Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: 047061b2-340c-4cc9-899b-0744dad0081f Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: instance-0000000c Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: 196608 Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: tempest-ServerRescueNegativeTestJSON-server-464264811 Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: 2026-06-26 10:38:17 Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: 192 Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: 0 Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: 0 Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: True Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: bare Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: 0 Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: ide Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: virtio Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: pc Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: virtio Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: virtio Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: virtio Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: tempest-ServerRescueNegativeTestJSON-1439990304-project-member Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: tempest-ServerRescueNegativeTestJSON-1439990304 Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: 047061b2-340c-4cc9-899b-0744dad0081f Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: 047061b2-340c-4cc9-899b-0744dad0081f Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: hvm Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: 128 Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: Jun 26 10:38:19.026620 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:38:19.034378 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Instance destroyed successfully. Jun 26 10:38:19.086092 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-0c1180ac-2832-434a-b296-bd6e32acf6f8 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "4b4a4a7e-d584-427e-91d2-7d9e710ea2a3" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 3.383s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:19.140624 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:19.219804 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "212147b0-26de-42cd-b43d-057ec8d61c72" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:19.219804 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "212147b0-26de-42cd-b43d-057ec8d61c72" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:19.271112 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:38:19.271266 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:38:19.271391 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:38:19.271503 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] No VIF found with MAC fa:16:3e:4c:ec:5e, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:38:19.272069 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Using config drive Jun 26 10:38:19.284459 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lazy-loading 'flavor' on Instance uuid 0b93909a-db10-4b65-b5a7-0aa3f0a47da7 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:19.417941 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:38:19.720181 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Detaching volume 47f52d31-fbea-432a-bdb6-e4f813146c47 Jun 26 10:38:19.763096 np0000003731 nova-compute[98967]: INFO nova.virt.block_device [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Attempting to driver detach volume 47f52d31-fbea-432a-bdb6-e4f813146c47 from mountpoint /dev/vdb Jun 26 10:38:19.766170 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Found disk vdb by alias ua-47f52d31-fbea-432a-bdb6-e4f813146c47 {{(pid=98967) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 26 10:38:19.768841 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Found disk vdb by alias ua-47f52d31-fbea-432a-bdb6-e4f813146c47 {{(pid=98967) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 26 10:38:19.768972 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Attempting to detach device vdb from instance 212147b0-26de-42cd-b43d-057ec8d61c72 from the persistent domain config. {{(pid=98967) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 26 10:38:19.769198 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] detach device xml: Jun 26 10:38:19.769198 np0000003731 nova-compute[98967]: Jun 26 10:38:19.769198 np0000003731 nova-compute[98967]: Jun 26 10:38:19.769198 np0000003731 nova-compute[98967]: Jun 26 10:38:19.769198 np0000003731 nova-compute[98967]: Jun 26 10:38:19.769198 np0000003731 nova-compute[98967]: 47f52d31-fbea-432a-bdb6-e4f813146c47 Jun 26 10:38:19.769198 np0000003731 nova-compute[98967]: Jun 26 10:38:19.769198 np0000003731 nova-compute[98967]:
Jun 26 10:38:19.769198 np0000003731 nova-compute[98967]: Jun 26 10:38:19.769198 np0000003731 nova-compute[98967]: {{(pid=98967) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 26 10:38:19.775643 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lazy-loading 'ec2_ids' on Instance uuid 81a0f65d-2017-4275-aabe-88bc8c81225d {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:19.779428 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Successfully detached device vdb from instance 212147b0-26de-42cd-b43d-057ec8d61c72 from the persistent domain config. Jun 26 10:38:19.779517 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] (1/8): Attempting to detach device vdb with device alias ua-47f52d31-fbea-432a-bdb6-e4f813146c47 from instance 212147b0-26de-42cd-b43d-057ec8d61c72 from the live domain config. {{(pid=98967) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 26 10:38:19.779755 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] detach device xml: Jun 26 10:38:19.779755 np0000003731 nova-compute[98967]: Jun 26 10:38:19.779755 np0000003731 nova-compute[98967]: Jun 26 10:38:19.779755 np0000003731 nova-compute[98967]: Jun 26 10:38:19.779755 np0000003731 nova-compute[98967]: Jun 26 10:38:19.779755 np0000003731 nova-compute[98967]: 47f52d31-fbea-432a-bdb6-e4f813146c47 Jun 26 10:38:19.779755 np0000003731 nova-compute[98967]: Jun 26 10:38:19.779755 np0000003731 nova-compute[98967]:
Jun 26 10:38:19.779755 np0000003731 nova-compute[98967]: Jun 26 10:38:19.779755 np0000003731 nova-compute[98967]: {{(pid=98967) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 26 10:38:19.926340 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Compute_service record updated for np0000003731:np0000003731 {{(pid=98967) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 26 10:38:19.933240 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.746s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:19.933240 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c09b640-bf92-4d6d-9697-a7b6890dc62a tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.553s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:19.933240 np0000003731 nova-compute[98967]: DEBUG oslo.service.backend._threading.loopingcall [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 44.19 seconds {{(pid=98967) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 26 10:38:20.282407 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Object Instance<81a0f65d-2017-4275-aabe-88bc8c81225d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:38:20.282550 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lazy-loading 'keypairs' on Instance uuid 81a0f65d-2017-4275-aabe-88bc8c81225d {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:20.294197 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7b76800a-4a0a-420f-a7d4-29a03cb864c8 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 4.488s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:20.555387 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:38:20.555387 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:38:20.555387 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:38:20.555387 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] No VIF found with MAC fa:16:3e:1b:55:09, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:38:20.555387 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Using config drive Jun 26 10:38:20.581185 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-7c09b640-bf92-4d6d-9697-a7b6890dc62a tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:38:20.581979 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-7c09b640-bf92-4d6d-9697-a7b6890dc62a tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:38:20.785468 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Object Instance<81a0f65d-2017-4275-aabe-88bc8c81225d> lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:38:20.795351 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:20.919378 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Creating config drive at /opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d/disk.config Jun 26 10:38:20.924795 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfhl9vtgp {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:20.972158 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpfhl9vtgp" returned: 0 in 0.047s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:21.056496 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'ec2_ids' on Instance uuid 047061b2-340c-4cc9-899b-0744dad0081f {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:21.084911 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-7c09b640-bf92-4d6d-9697-a7b6890dc62a tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:38:21.309727 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-cb0380ab-9cb7-4509-b636-229226fcf5d3 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:21.309946 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-cb0380ab-9cb7-4509-b636-229226fcf5d3 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:21.310115 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-cb0380ab-9cb7-4509-b636-229226fcf5d3 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:21.310249 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-cb0380ab-9cb7-4509-b636-229226fcf5d3 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:21.310356 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-cb0380ab-9cb7-4509-b636-229226fcf5d3 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:21.312583 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-cb0380ab-9cb7-4509-b636-229226fcf5d3 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Terminating instance Jun 26 10:38:21.406816 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:21.445468 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:21.473916 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2c1cfdf4-7322-4e48-aed4-c320820aebca tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "64a636b4-e106-4968-8740-9938e9b2bcc8" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:21.474144 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2c1cfdf4-7322-4e48-aed4-c320820aebca tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "64a636b4-e106-4968-8740-9938e9b2bcc8" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:21.474337 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2c1cfdf4-7322-4e48-aed4-c320820aebca tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "64a636b4-e106-4968-8740-9938e9b2bcc8-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:21.474879 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2c1cfdf4-7322-4e48-aed4-c320820aebca tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "64a636b4-e106-4968-8740-9938e9b2bcc8-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:21.475086 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2c1cfdf4-7322-4e48-aed4-c320820aebca tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "64a636b4-e106-4968-8740-9938e9b2bcc8-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:21.479296 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-2c1cfdf4-7322-4e48-aed4-c320820aebca tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Terminating instance Jun 26 10:38:21.529083 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:21.560366 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Object Instance<047061b2-340c-4cc9-899b-0744dad0081f> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:38:21.560848 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'keypairs' on Instance uuid 047061b2-340c-4cc9-899b-0744dad0081f {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:21.595338 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c09b640-bf92-4d6d-9697-a7b6890dc62a tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.668s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:21.681038 np0000003731 nova-compute[98967]: INFO nova.scheduler.client.report [None req-7c09b640-bf92-4d6d-9697-a7b6890dc62a tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Deleted allocations for instance 5bc6474f-1a05-4e8a-9553-a5597c60728d Jun 26 10:38:21.712178 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:21.746742 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:21.755683 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:21.760970 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:21.785381 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:21.794325 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:21.821249 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-cb0380ab-9cb7-4509-b636-229226fcf5d3 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Start destroying the instance on the hypervisor. {{(pid=98967) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 26 10:38:21.854870 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:21.858882 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:21.885232 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:21.974652 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:21.987424 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-2c1cfdf4-7322-4e48-aed4-c320820aebca tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Start destroying the instance on the hypervisor. {{(pid=98967) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 26 10:38:22.047675 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:22.050485 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:22.063674 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Object Instance<047061b2-340c-4cc9-899b-0744dad0081f> lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:38:22.067889 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:22.076481 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:22.093331 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:22.109671 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:22.135276 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:22.172551 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:22.198383 np0000003731 nova-compute[98967]: DEBUG nova.utils [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Queued Task(fn=>, remaining_delay=14.999443748999965 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:22.219054 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Instance destroyed successfully. Jun 26 10:38:22.219753 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-cb0380ab-9cb7-4509-b636-229226fcf5d3 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lazy-loading 'resources' on Instance uuid 0b93909a-db10-4b65-b5a7-0aa3f0a47da7 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:22.251691 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Creating config drive at /opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk.config.rescue Jun 26 10:38:22.254466 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcw_b6xyp {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:22.277697 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b89d9d7d-1efc-455c-844a-51f26fcd0916 req-6df954b0-32b7-4bc0-9d22-baa4d969973c service nova] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Received event network-vif-unplugged-2608654f-5761-4d82-a2ab-2a67e20a1c08 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:22.285171 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b89d9d7d-1efc-455c-844a-51f26fcd0916 req-6df954b0-32b7-4bc0-9d22-baa4d969973c service nova] Acquiring lock "64a636b4-e106-4968-8740-9938e9b2bcc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:22.285171 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b89d9d7d-1efc-455c-844a-51f26fcd0916 req-6df954b0-32b7-4bc0-9d22-baa4d969973c service nova] Lock "64a636b4-e106-4968-8740-9938e9b2bcc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:22.285171 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b89d9d7d-1efc-455c-844a-51f26fcd0916 req-6df954b0-32b7-4bc0-9d22-baa4d969973c service nova] Lock "64a636b4-e106-4968-8740-9938e9b2bcc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:22.285171 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b89d9d7d-1efc-455c-844a-51f26fcd0916 req-6df954b0-32b7-4bc0-9d22-baa4d969973c service nova] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] No waiting events found dispatching network-vif-unplugged-2608654f-5761-4d82-a2ab-2a67e20a1c08 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:22.285171 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b89d9d7d-1efc-455c-844a-51f26fcd0916 req-6df954b0-32b7-4bc0-9d22-baa4d969973c service nova] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Received event network-vif-unplugged-2608654f-5761-4d82-a2ab-2a67e20a1c08 for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:38:22.308751 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpcw_b6xyp" returned: 0 in 0.054s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:22.340878 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:22.378966 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:22.411533 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0003829920001408027 future=) submitted to {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:22.411533 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:22.411533 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=7.35086976499997 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:22.411533 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=7.350747558999956 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:22.411533 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Emitting event Stopped> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:38:22.411533 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] VM Stopped (Lifecycle Event) Jun 26 10:38:22.411533 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:22.581825 np0000003731 nova-compute[98967]: DEBUG nova.utils [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Queued Task(fn=>, remaining_delay=14.999708991000034 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:22.608249 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Instance destroyed successfully. Jun 26 10:38:22.611154 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-2c1cfdf4-7322-4e48-aed4-c320820aebca tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lazy-loading 'resources' on Instance uuid 64a636b4-e106-4968-8740-9938e9b2bcc8 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:22.700142 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-7c09b640-bf92-4d6d-9697-a7b6890dc62a tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Lock "5bc6474f-1a05-4e8a-9553-a5597c60728d" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 8.811s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:22.700498 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:22.721630 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:22.726131 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-cb0380ab-9cb7-4509-b636-229226fcf5d3 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-574467017-1',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-testmultiattachvolumeswap-server-574467017-1',id=5,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSbRbM1YJq9Ia0wxRJgshSkjCUzmlOfS3KQV3f22/KUIjk7ds3Wz4HXS6ODe9kZD4ztp/Tqp7VDqOLvvsbyqTpmrjlrWC9hHWD73OsN3TnhrYQef72rYY9KvkUUZJbIrA==',key_name='tempest-keypair-932697520',keypairs=,launch_index=0,launched_at=2026-06-26T10:37:16Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='b4242a2b73cf4564ac8f9f2cb9c7a7bf',ramdisk_id='',reservation_id='r-rdkz1jh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-1408323251',owner_user_name='tempest-TestMultiAttachVolumeSwap-1408323251-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-26T10:37:17Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='969d94ff13fa470c8c07bc5e419d3e13',uuid=0b93909a-db10-4b65-b5a7-0aa3f0a47da7,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f3b40b67-c684-437c-83df-5ff22d2249e8", "address": "fa:16:3e:f2:01:1a", "network": {"id": "ee9d6726-90f0-4fdf-978b-d97dc4dc243d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1209858046-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b4242a2b73cf4564ac8f9f2cb9c7a7bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b40b67-c6", "ovs_interfaceid": "f3b40b67-c684-437c-83df-5ff22d2249e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 26 10:38:22.726434 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-cb0380ab-9cb7-4509-b636-229226fcf5d3 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Converting VIF {"id": "f3b40b67-c684-437c-83df-5ff22d2249e8", "address": "fa:16:3e:f2:01:1a", "network": {"id": "ee9d6726-90f0-4fdf-978b-d97dc4dc243d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1209858046-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.30", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b4242a2b73cf4564ac8f9f2cb9c7a7bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf3b40b67-c6", "ovs_interfaceid": "f3b40b67-c684-437c-83df-5ff22d2249e8", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:38:22.727742 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-cb0380ab-9cb7-4509-b636-229226fcf5d3 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:f2:01:1a,bridge_name='br-int',has_traffic_filtering=True,id=f3b40b67-c684-437c-83df-5ff22d2249e8,network=Network(ee9d6726-90f0-4fdf-978b-d97dc4dc243d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3b40b67-c6') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:38:22.727742 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-cb0380ab-9cb7-4509-b636-229226fcf5d3 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:01:1a,bridge_name='br-int',has_traffic_filtering=True,id=f3b40b67-c684-437c-83df-5ff22d2249e8,network=Network(ee9d6726-90f0-4fdf-978b-d97dc4dc243d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3b40b67-c6') {{(pid=98967) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 26 10:38:22.728860 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:22.730062 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:22.730298 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf3b40b67-c6, bridge=br-int, if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:22.731493 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:22.732332 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:22.745434 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:38:22.745787 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] VM Started (Lifecycle Event) Jun 26 10:38:22.762217 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:22.773836 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:22.776550 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:22.776783 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=584b8417-b2a6-4229-8d56-8aed3e5869f6) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:22.777976 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:22.778553 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:22.790429 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:22.792443 np0000003731 nova-compute[98967]: INFO os_vif [None req-cb0380ab-9cb7-4509-b636-229226fcf5d3 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:f2:01:1a,bridge_name='br-int',has_traffic_filtering=True,id=f3b40b67-c684-437c-83df-5ff22d2249e8,network=Network(ee9d6726-90f0-4fdf-978b-d97dc4dc243d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf3b40b67-c6') Jun 26 10:38:22.796026 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-cb0380ab-9cb7-4509-b636-229226fcf5d3 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Deleting instance files /opt/stack/data/nova/instances/0b93909a-db10-4b65-b5a7-0aa3f0a47da7_del Jun 26 10:38:22.796026 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-cb0380ab-9cb7-4509-b636-229226fcf5d3 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Deletion of /opt/stack/data/nova/instances/0b93909a-db10-4b65-b5a7-0aa3f0a47da7_del complete Jun 26 10:38:22.845469 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-47f52d31-fbea-432a-bdb6-e4f813146c47 for instance 212147b0-26de-42cd-b43d-057ec8d61c72 {{(pid=98967) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 26 10:38:22.867291 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:22.900230 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:22.903693 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: c43215aa-be15-4556-8162-bcd9793048c0] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:23.013760 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:23.064912 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:23.126988 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-2c1cfdf4-7322-4e48-aed4-c320820aebca tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:36:50Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-TestMultiAttachVolumeSwap-server-574467017-2',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-testmultiattachvolumeswap-server-574467017-2',id=6,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDSbRbM1YJq9Ia0wxRJgshSkjCUzmlOfS3KQV3f22/KUIjk7ds3Wz4HXS6ODe9kZD4ztp/Tqp7VDqOLvvsbyqTpmrjlrWC9hHWD73OsN3TnhrYQef72rYY9KvkUUZJbIrA==',key_name='tempest-keypair-932697520',keypairs=,launch_index=1,launched_at=2026-06-26T10:37:11Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='b4242a2b73cf4564ac8f9f2cb9c7a7bf',ramdisk_id='',reservation_id='r-rdkz1jh5',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TestMultiAttachVolumeSwap-1408323251',owner_user_name='tempest-TestMultiAttachVolumeSwap-1408323251-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-26T10:37:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='969d94ff13fa470c8c07bc5e419d3e13',uuid=64a636b4-e106-4968-8740-9938e9b2bcc8,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "2608654f-5761-4d82-a2ab-2a67e20a1c08", "address": "fa:16:3e:4b:6e:75", "network": {"id": "ee9d6726-90f0-4fdf-978b-d97dc4dc243d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1209858046-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b4242a2b73cf4564ac8f9f2cb9c7a7bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2608654f-57", "ovs_interfaceid": "2608654f-5761-4d82-a2ab-2a67e20a1c08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 26 10:38:23.126988 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-2c1cfdf4-7322-4e48-aed4-c320820aebca tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Converting VIF {"id": "2608654f-5761-4d82-a2ab-2a67e20a1c08", "address": "fa:16:3e:4b:6e:75", "network": {"id": "ee9d6726-90f0-4fdf-978b-d97dc4dc243d", "bridge": "br-int", "label": "tempest-TestMultiAttachVolumeSwap-1209858046-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "b4242a2b73cf4564ac8f9f2cb9c7a7bf", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap2608654f-57", "ovs_interfaceid": "2608654f-5761-4d82-a2ab-2a67e20a1c08", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:38:23.126988 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-2c1cfdf4-7322-4e48-aed4-c320820aebca tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:4b:6e:75,bridge_name='br-int',has_traffic_filtering=True,id=2608654f-5761-4d82-a2ab-2a67e20a1c08,network=Network(ee9d6726-90f0-4fdf-978b-d97dc4dc243d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2608654f-57') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:38:23.126988 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-2c1cfdf4-7322-4e48-aed4-c320820aebca tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:6e:75,bridge_name='br-int',has_traffic_filtering=True,id=2608654f-5761-4d82-a2ab-2a67e20a1c08,network=Network(ee9d6726-90f0-4fdf-978b-d97dc4dc243d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2608654f-57') {{(pid=98967) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 26 10:38:23.126988 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:23.126988 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap2608654f-57, bridge=br-int, if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:23.126988 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:23.126988 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:23.126988 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:23.126988 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=56b2b1f2-453e-4f6d-9925-654a1ddbf1de) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:23.126988 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:23.129527 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:23.136311 np0000003731 nova-compute[98967]: INFO os_vif [None req-2c1cfdf4-7322-4e48-aed4-c320820aebca tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:4b:6e:75,bridge_name='br-int',has_traffic_filtering=True,id=2608654f-5761-4d82-a2ab-2a67e20a1c08,network=Network(ee9d6726-90f0-4fdf-978b-d97dc4dc243d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap2608654f-57') Jun 26 10:38:23.136311 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-2c1cfdf4-7322-4e48-aed4-c320820aebca tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Deleting instance files /opt/stack/data/nova/instances/64a636b4-e106-4968-8740-9938e9b2bcc8_del Jun 26 10:38:23.139235 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-2c1cfdf4-7322-4e48-aed4-c320820aebca tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Deletion of /opt/stack/data/nova/instances/64a636b4-e106-4968-8740-9938e9b2bcc8_del complete Jun 26 10:38:23.177854 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:23.187431 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:23.251021 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:23.255036 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Paused> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:38:23.255804 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] VM Paused (Lifecycle Event) Jun 26 10:38:23.299913 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-cb0380ab-9cb7-4509-b636-229226fcf5d3 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Took 1.48 seconds to destroy the instance on the hypervisor. Jun 26 10:38:23.300588 np0000003731 nova-compute[98967]: DEBUG oslo.service.backend._common.loopingcall [None req-cb0380ab-9cb7-4509-b636-229226fcf5d3 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98967) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 26 10:38:23.300805 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [-] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Deallocating network for instance {{(pid=98967) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 26 10:38:23.300943 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [-] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] deallocate_for_instance() {{(pid=98967) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 26 10:38:23.301184 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:23.347026 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-6a422fa9-2c8a-4f9b-abf1-4430d1d29177 req-7e4c70b8-aff7-4f18-8561-a7b1563965a8 service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Received event network-vif-plugged-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:23.347242 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-6a422fa9-2c8a-4f9b-abf1-4430d1d29177 req-7e4c70b8-aff7-4f18-8561-a7b1563965a8 service nova] Acquiring lock "047061b2-340c-4cc9-899b-0744dad0081f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:23.347434 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-6a422fa9-2c8a-4f9b-abf1-4430d1d29177 req-7e4c70b8-aff7-4f18-8561-a7b1563965a8 service nova] Lock "047061b2-340c-4cc9-899b-0744dad0081f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:23.347623 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-6a422fa9-2c8a-4f9b-abf1-4430d1d29177 req-7e4c70b8-aff7-4f18-8561-a7b1563965a8 service nova] Lock "047061b2-340c-4cc9-899b-0744dad0081f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:23.347716 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-6a422fa9-2c8a-4f9b-abf1-4430d1d29177 req-7e4c70b8-aff7-4f18-8561-a7b1563965a8 service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] No waiting events found dispatching network-vif-plugged-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:23.347878 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-6a422fa9-2c8a-4f9b-abf1-4430d1d29177 req-7e4c70b8-aff7-4f18-8561-a7b1563965a8 service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Received unexpected event network-vif-plugged-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 for instance with vm_state active and task_state rescuing. Jun 26 10:38:23.386960 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b7b1bc39-b7ab-46ee-ad9a-c11a611e3101 req-4c5ec7f0-2f9e-424d-b00a-b42f6641cecd service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Received event network-vif-plugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:23.387526 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b7b1bc39-b7ab-46ee-ad9a-c11a611e3101 req-4c5ec7f0-2f9e-424d-b00a-b42f6641cecd service nova] Acquiring lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:23.387660 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b7b1bc39-b7ab-46ee-ad9a-c11a611e3101 req-4c5ec7f0-2f9e-424d-b00a-b42f6641cecd service nova] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:23.387760 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b7b1bc39-b7ab-46ee-ad9a-c11a611e3101 req-4c5ec7f0-2f9e-424d-b00a-b42f6641cecd service nova] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:23.388042 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b7b1bc39-b7ab-46ee-ad9a-c11a611e3101 req-4c5ec7f0-2f9e-424d-b00a-b42f6641cecd service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Processing event network-vif-plugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:38:23.388492 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:38:23.400228 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Guest created on hypervisor {{(pid=98967) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 26 10:38:23.403320 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Instance spawned successfully. Jun 26 10:38:23.510832 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:23.658616 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-2c1cfdf4-7322-4e48-aed4-c320820aebca tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Took 1.67 seconds to destroy the instance on the hypervisor. Jun 26 10:38:23.659523 np0000003731 nova-compute[98967]: DEBUG oslo.service.backend._common.loopingcall [None req-2c1cfdf4-7322-4e48-aed4-c320820aebca tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98967) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 26 10:38:23.659871 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [-] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Deallocating network for instance {{(pid=98967) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 26 10:38:23.660156 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [-] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] deallocate_for_instance() {{(pid=98967) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 26 10:38:23.660445 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:23.766424 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:23.772232 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Received event ua-47f52d31-fbea-432a-bdb6-e4f813146c47> from libvirt while the driver is waiting for it; dispatched. {{(pid=98967) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 26 10:38:23.783476 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:38:23.783476 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] VM Resumed (Lifecycle Event) Jun 26 10:38:23.788330 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Successfully detached device vdb from instance 212147b0-26de-42cd-b43d-057ec8d61c72 from the live domain config. Jun 26 10:38:23.812280 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:23.862832 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] calling os-brick to detach iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 26 10:38:23.863294 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47', 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47f52d31-fbea-432a-bdb6-e4f813146c47', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:38:23.863521 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:38:23.863929 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:38:23.864280 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47', 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '47f52d31-fbea-432a-bdb6-e4f813146c47', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 10:38:23.864704 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47', 0)] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 10:38:23.905530 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:23.905530 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:23.905530 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:23.905530 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:23.905530 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:23.905530 np0000003731 nova-compute[98967]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:38:23.905530 np0000003731 nova-compute[98967]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:38:23.905530 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:23.905530 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:23.905530 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:23.905530 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:23.905530 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:23.905530 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:38:23.905783 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:23.905783 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:23.905783 np0000003731 nova-compute[98967]: tcp: [16] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:23.905783 np0000003731 nova-compute[98967]: tcp: [17] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47 (non-flash) Jun 26 10:38:23.905783 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:23.905783 np0000003731 nova-compute[98967]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:38:23.905783 np0000003731 nova-compute[98967]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:38:23.905783 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:23.905783 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:23.905783 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:23.905783 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:23.905783 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:23.905783 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:38:23.905783 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47', '16'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47', '17'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '2'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020', '7'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77', '9')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 10:38:23.906338 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47', '16')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:38:23.908679 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47', '17')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:38:23.909818 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Resulting device map defaultdict(. at 0x75f070660400>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47'): ({'sdo'}, set())}) {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 10:38:23.909818 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Removing multipathed devices sdn, sdo {{(pid=98967) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 10:38:23.909818 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Flush multipath device 330000000f0f4940b {{(pid=98967) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 26 10:38:23.945426 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:38:24.000419 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:38:24.043554 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Checking to see if SCSI volumes sdn, sdo have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 10:38:24.043554 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] SCSI volumes sdn, sdo have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 10:38:24.045221 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Checking to see if device paths {'sdn', 'sdo'} are still under multipathd monitoring {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 10:38:24.061185 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Device paths {'sdn', 'sdo'} have been removed from multipathd monitoring. {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 10:38:24.061426 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47')] {{(pid=98967) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 10:38:24.078946 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:24.137018 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 16, target: iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47, portal: 192.168.40.100,3260] Jun 26 10:38:24.137018 np0000003731 nova-compute[98967]: Logout of [sid: 16, target: iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47, portal: 192.168.40.100,3260] successful. Jun 26 10:38:24.137018 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:24.166180 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:24.185626 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:24.240116 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 17, target: iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47, portal: 192.168.50.100,3260] Jun 26 10:38:24.240116 np0000003731 nova-compute[98967]: Logout of [sid: 17, target: iqn.2023-03.storpool.com:os--volume-47f52d31-fbea-432a-bdb6-e4f813146c47, portal: 192.168.50.100,3260] successful. Jun 26 10:38:24.240116 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:24.252472 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-916625a9-81bf-4f2e-86d6-532abf42c90c req-e5333381-554b-4063-8f96-806a5a2c6d43 service nova] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Received event network-vif-deleted-f3b40b67-c684-437c-83df-5ff22d2249e8 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:24.252472 np0000003731 nova-compute[98967]: INFO nova.compute.manager [req-916625a9-81bf-4f2e-86d6-532abf42c90c req-e5333381-554b-4063-8f96-806a5a2c6d43 service nova] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Neutron deleted interface f3b40b67-c684-437c-83df-5ff22d2249e8; detaching it from the instance and deleting it from the info cache Jun 26 10:38:24.255436 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-916625a9-81bf-4f2e-86d6-532abf42c90c req-e5333381-554b-4063-8f96-806a5a2c6d43 service nova] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Detach interface failed, port_id=f3b40b67-c684-437c-83df-5ff22d2249e8, reason: Instance 0b93909a-db10-4b65-b5a7-0aa3f0a47da7 could not be found. {{(pid=98967) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 26 10:38:24.258607 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:24.259028 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.395s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:38:24.259073 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] <== disconnect_volume: return (395ms) None {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:38:24.259270 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Disconnected iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 26 10:38:24.275669 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:24.278841 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:38:24.357768 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7269a878-c605-4b91-8a0f-01a70d9e4fa6 req-72883ebd-0924-4b00-a532-255cb90cf9c3 service nova] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Received event network-vif-unplugged-2608654f-5761-4d82-a2ab-2a67e20a1c08 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:24.357768 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7269a878-c605-4b91-8a0f-01a70d9e4fa6 req-72883ebd-0924-4b00-a532-255cb90cf9c3 service nova] Acquiring lock "64a636b4-e106-4968-8740-9938e9b2bcc8-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:24.357768 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7269a878-c605-4b91-8a0f-01a70d9e4fa6 req-72883ebd-0924-4b00-a532-255cb90cf9c3 service nova] Lock "64a636b4-e106-4968-8740-9938e9b2bcc8-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:24.357768 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7269a878-c605-4b91-8a0f-01a70d9e4fa6 req-72883ebd-0924-4b00-a532-255cb90cf9c3 service nova] Lock "64a636b4-e106-4968-8740-9938e9b2bcc8-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:24.357768 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7269a878-c605-4b91-8a0f-01a70d9e4fa6 req-72883ebd-0924-4b00-a532-255cb90cf9c3 service nova] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] No waiting events found dispatching network-vif-unplugged-2608654f-5761-4d82-a2ab-2a67e20a1c08 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:24.357768 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7269a878-c605-4b91-8a0f-01a70d9e4fa6 req-72883ebd-0924-4b00-a532-255cb90cf9c3 service nova] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Received event network-vif-unplugged-2608654f-5761-4d82-a2ab-2a67e20a1c08 for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:38:24.391364 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:24.501890 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-c179fffa-c747-455b-a33c-5d37039ca2b3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:24.673024 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [-] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:38:24.783397 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] During sync_power_state the instance has a pending task (spawning). Skip. Jun 26 10:38:24.783397 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Removed pending STOPPED event for 047061b2-340c-4cc9-899b-0744dad0081f due to new event Resumed> {{(pid=98967) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 26 10:38:24.783397 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:38:24.783397 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] VM Resumed (Lifecycle Event) Jun 26 10:38:24.844857 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lazy-loading 'flavor' on Instance uuid 212147b0-26de-42cd-b43d-057ec8d61c72 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:24.897673 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [-] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:38:24.906628 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-ede010e0-025b-40a6-b852-9d097e3e36fe tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d" "released" by "nova.compute.manager.ComputeManager.unshelve_instance..do_unshelve_instance" :: held 26.264s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:25.175340 np0000003731 nova-compute[98967]: INFO nova.compute.manager [-] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Took 1.87 seconds to deallocate network for instance. Jun 26 10:38:25.286726 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:25.288868 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:38:25.401993 np0000003731 nova-compute[98967]: INFO nova.compute.manager [-] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Took 1.74 seconds to deallocate network for instance. Jun 26 10:38:25.475288 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-35b9e479-a90b-4661-a9da-1738d0a22b27 req-423e94a4-3158-4ad4-a33b-ba8fc200d911 service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Received event network-vif-plugged-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:25.475475 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-35b9e479-a90b-4661-a9da-1738d0a22b27 req-423e94a4-3158-4ad4-a33b-ba8fc200d911 service nova] Acquiring lock "047061b2-340c-4cc9-899b-0744dad0081f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:25.475602 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-35b9e479-a90b-4661-a9da-1738d0a22b27 req-423e94a4-3158-4ad4-a33b-ba8fc200d911 service nova] Lock "047061b2-340c-4cc9-899b-0744dad0081f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:25.475707 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-35b9e479-a90b-4661-a9da-1738d0a22b27 req-423e94a4-3158-4ad4-a33b-ba8fc200d911 service nova] Lock "047061b2-340c-4cc9-899b-0744dad0081f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:25.475939 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-35b9e479-a90b-4661-a9da-1738d0a22b27 req-423e94a4-3158-4ad4-a33b-ba8fc200d911 service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] No waiting events found dispatching network-vif-plugged-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:25.475939 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-35b9e479-a90b-4661-a9da-1738d0a22b27 req-423e94a4-3158-4ad4-a33b-ba8fc200d911 service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Received unexpected event network-vif-plugged-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 for instance with vm_state rescued and task_state None. Jun 26 10:38:25.524155 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-47b5f723-6217-4d0b-84e5-2c97f0343b3e req-a3013234-c921-4df1-a127-f9534d75e454 service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Received event network-vif-plugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:25.524909 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-47b5f723-6217-4d0b-84e5-2c97f0343b3e req-a3013234-c921-4df1-a127-f9534d75e454 service nova] Acquiring lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:25.525125 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-47b5f723-6217-4d0b-84e5-2c97f0343b3e req-a3013234-c921-4df1-a127-f9534d75e454 service nova] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:25.525282 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-47b5f723-6217-4d0b-84e5-2c97f0343b3e req-a3013234-c921-4df1-a127-f9534d75e454 service nova] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:25.528231 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-47b5f723-6217-4d0b-84e5-2c97f0343b3e req-a3013234-c921-4df1-a127-f9534d75e454 service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] No waiting events found dispatching network-vif-plugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:25.528231 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-47b5f723-6217-4d0b-84e5-2c97f0343b3e req-a3013234-c921-4df1-a127-f9534d75e454 service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Received unexpected event network-vif-plugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 for instance with vm_state active and task_state None. Jun 26 10:38:25.528231 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-47b5f723-6217-4d0b-84e5-2c97f0343b3e req-a3013234-c921-4df1-a127-f9534d75e454 service nova] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Received event network-vif-unplugged-f3b40b67-c684-437c-83df-5ff22d2249e8 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:25.528231 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-47b5f723-6217-4d0b-84e5-2c97f0343b3e req-a3013234-c921-4df1-a127-f9534d75e454 service nova] Acquiring lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:25.528231 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-47b5f723-6217-4d0b-84e5-2c97f0343b3e req-a3013234-c921-4df1-a127-f9534d75e454 service nova] Lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:25.528231 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-47b5f723-6217-4d0b-84e5-2c97f0343b3e req-a3013234-c921-4df1-a127-f9534d75e454 service nova] Lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:25.528231 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-47b5f723-6217-4d0b-84e5-2c97f0343b3e req-a3013234-c921-4df1-a127-f9534d75e454 service nova] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] No waiting events found dispatching network-vif-unplugged-f3b40b67-c684-437c-83df-5ff22d2249e8 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:25.528231 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-47b5f723-6217-4d0b-84e5-2c97f0343b3e req-a3013234-c921-4df1-a127-f9534d75e454 service nova] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Received unexpected event network-vif-unplugged-f3b40b67-c684-437c-83df-5ff22d2249e8 for instance with vm_state deleted and task_state None. Jun 26 10:38:25.528231 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-47b5f723-6217-4d0b-84e5-2c97f0343b3e req-a3013234-c921-4df1-a127-f9534d75e454 service nova] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Received event network-vif-deleted-2608654f-5761-4d82-a2ab-2a67e20a1c08 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:25.528231 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-47b5f723-6217-4d0b-84e5-2c97f0343b3e req-a3013234-c921-4df1-a127-f9534d75e454 service nova] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Received event network-vif-unplugged-f3b40b67-c684-437c-83df-5ff22d2249e8 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:25.528231 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-47b5f723-6217-4d0b-84e5-2c97f0343b3e req-a3013234-c921-4df1-a127-f9534d75e454 service nova] Acquiring lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:25.528231 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-47b5f723-6217-4d0b-84e5-2c97f0343b3e req-a3013234-c921-4df1-a127-f9534d75e454 service nova] Lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:25.528231 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-47b5f723-6217-4d0b-84e5-2c97f0343b3e req-a3013234-c921-4df1-a127-f9534d75e454 service nova] Lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:25.528231 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-47b5f723-6217-4d0b-84e5-2c97f0343b3e req-a3013234-c921-4df1-a127-f9534d75e454 service nova] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] No waiting events found dispatching network-vif-unplugged-f3b40b67-c684-437c-83df-5ff22d2249e8 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:25.528231 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-47b5f723-6217-4d0b-84e5-2c97f0343b3e req-a3013234-c921-4df1-a127-f9534d75e454 service nova] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Received unexpected event network-vif-unplugged-f3b40b67-c684-437c-83df-5ff22d2249e8 for instance with vm_state deleted and task_state None. Jun 26 10:38:25.680889 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-cb0380ab-9cb7-4509-b636-229226fcf5d3 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:25.681201 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-cb0380ab-9cb7-4509-b636-229226fcf5d3 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:25.803841 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:38:25.803841 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] VM Started (Lifecycle Event) Jun 26 10:38:25.854023 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-bcc23b98-697a-4c86-9801-ea92b8aaa241 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "212147b0-26de-42cd-b43d-057ec8d61c72" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 6.636s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:25.911330 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2c1cfdf4-7322-4e48-aed4-c320820aebca tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:26.301703 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:26.301703 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:38:26.324712 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-cb0380ab-9cb7-4509-b636-229226fcf5d3 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:38:26.331619 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-cb0380ab-9cb7-4509-b636-229226fcf5d3 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:38:26.668524 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-2171e2b4-ef8b-4d2a-b836-d40e9042f9ec tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Unrescuing Jun 26 10:38:26.668709 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2171e2b4-ef8b-4d2a-b836-d40e9042f9ec tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "refresh_cache-047061b2-340c-4cc9-899b-0744dad0081f" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:38:26.668778 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2171e2b4-ef8b-4d2a-b836-d40e9042f9ec tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquired lock "refresh_cache-047061b2-340c-4cc9-899b-0744dad0081f" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:38:26.668927 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-2171e2b4-ef8b-4d2a-b836-d40e9042f9ec tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:38:26.800961 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] During sync_power_state the instance has a pending task (unrescuing). Skip. Jun 26 10:38:26.827779 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-cb0380ab-9cb7-4509-b636-229226fcf5d3 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:38:26.991291 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:27.174259 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-2171e2b4-ef8b-4d2a-b836-d40e9042f9ec tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:27.333666 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-cb0380ab-9cb7-4509-b636-229226fcf5d3 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.652s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:27.335255 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2c1cfdf4-7322-4e48-aed4-c320820aebca tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 1.423s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:27.414085 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:27.446914 np0000003731 nova-compute[98967]: INFO nova.scheduler.client.report [None req-cb0380ab-9cb7-4509-b636-229226fcf5d3 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Deleted allocations for instance 0b93909a-db10-4b65-b5a7-0aa3f0a47da7 Jun 26 10:38:27.769138 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-2171e2b4-ef8b-4d2a-b836-d40e9042f9ec tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:27.982330 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-2c1cfdf4-7322-4e48-aed4-c320820aebca tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:38:27.984084 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-2c1cfdf4-7322-4e48-aed4-c320820aebca tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:38:28.083122 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-2171e2b4-ef8b-4d2a-b836-d40e9042f9ec tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Updating instance_info_cache with network_info: [{"id": "d8b51bcb-01d0-46b9-a5ff-b3335f560c00", "address": "fa:16:3e:1b:55:09", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.8", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapd8b51bcb-01", "ovs_interfaceid": "d8b51bcb-01d0-46b9-a5ff-b3335f560c00", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:38:28.125788 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:28.376573 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "c1043abd-b0c0-439e-b065-8bef627483cb" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:28.376573 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "c1043abd-b0c0-439e-b065-8bef627483cb" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:28.455688 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-cb0380ab-9cb7-4509-b636-229226fcf5d3 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "0b93909a-db10-4b65-b5a7-0aa3f0a47da7" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.146s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:28.487192 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-2c1cfdf4-7322-4e48-aed4-c320820aebca tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:38:28.587570 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2171e2b4-ef8b-4d2a-b836-d40e9042f9ec tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Releasing lock "refresh_cache-047061b2-340c-4cc9-899b-0744dad0081f" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:38:28.588111 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-2171e2b4-ef8b-4d2a-b836-d40e9042f9ec tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'flavor' on Instance uuid 047061b2-340c-4cc9-899b-0744dad0081f {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:28.878495 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Starting instance... {{(pid=98967) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 26 10:38:28.996347 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2c1cfdf4-7322-4e48-aed4-c320820aebca tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.662s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:29.072374 np0000003731 nova-compute[98967]: INFO nova.scheduler.client.report [None req-2c1cfdf4-7322-4e48-aed4-c320820aebca tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Deleted allocations for instance 64a636b4-e106-4968-8740-9938e9b2bcc8 Jun 26 10:38:29.133202 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:29.144466 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:29.166436 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:29.338616 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:29.341655 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-c036372d-124d-48a3-87ae-4ffadd11ffd9 req-e37bf6b3-9d06-4914-bcb4-acf463a3eb11 service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Received event network-vif-unplugged-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:29.341655 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c036372d-124d-48a3-87ae-4ffadd11ffd9 req-e37bf6b3-9d06-4914-bcb4-acf463a3eb11 service nova] Acquiring lock "047061b2-340c-4cc9-899b-0744dad0081f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:29.341655 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c036372d-124d-48a3-87ae-4ffadd11ffd9 req-e37bf6b3-9d06-4914-bcb4-acf463a3eb11 service nova] Lock "047061b2-340c-4cc9-899b-0744dad0081f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:29.341655 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c036372d-124d-48a3-87ae-4ffadd11ffd9 req-e37bf6b3-9d06-4914-bcb4-acf463a3eb11 service nova] Lock "047061b2-340c-4cc9-899b-0744dad0081f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:29.341655 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-c036372d-124d-48a3-87ae-4ffadd11ffd9 req-e37bf6b3-9d06-4914-bcb4-acf463a3eb11 service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] No waiting events found dispatching network-vif-unplugged-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:29.342050 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-c036372d-124d-48a3-87ae-4ffadd11ffd9 req-e37bf6b3-9d06-4914-bcb4-acf463a3eb11 service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Received unexpected event network-vif-unplugged-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 for instance with vm_state rescued and task_state unrescuing. Jun 26 10:38:29.346739 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:29.442155 np0000003731 nova-compute[98967]: DEBUG nova.utils [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Queued Task(fn=>, remaining_delay=14.999683172999994 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:29.447300 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Instance destroyed successfully. Jun 26 10:38:29.450237 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:29.450441 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:29.455357 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98967) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 26 10:38:29.455542 np0000003731 nova-compute[98967]: INFO nova.compute.claims [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Claim successful on node np0000003731 Jun 26 10:38:29.461669 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-2171e2b4-ef8b-4d2a-b836-d40e9042f9ec tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'numa_topology' on Instance uuid 047061b2-340c-4cc9-899b-0744dad0081f {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:29.500611 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:29.749668 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0006378870000389725 future=) submitted to {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:29.749668 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:29.749668 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=1.0218566569999439 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:29.749949 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=1.0217755470000611 future=) was cancelled while queued, skipping {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:29.749949 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:29.749949 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=7.447050372999911 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:29.750091 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=7.446963713000059 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:29.750651 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Emitting event Stopped> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:38:29.750651 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] VM Stopped (Lifecycle Event) Jun 26 10:38:29.967469 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-2171e2b4-ef8b-4d2a-b836-d40e9042f9ec tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Object Instance<047061b2-340c-4cc9-899b-0744dad0081f> lazy-loaded attributes: flavor,numa_topology {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:38:30.084702 np0000003731 nova-compute[98967]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.49 seconds {{(pid=98967) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 26 10:38:30.085489 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2c1cfdf4-7322-4e48-aed4-c320820aebca tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Lock "64a636b4-e106-4968-8740-9938e9b2bcc8" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 8.611s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:30.253847 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: 5bc6474f-1a05-4e8a-9553-a5597c60728d] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:30.267943 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:30.475307 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:30.510300 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:30.514394 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:31.253203 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:31.253203 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:31.253203 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:31.253203 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:31.253203 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:31.253203 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:31.253203 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:31.253203 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:31.253203 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Terminating instance Jun 26 10:38:31.253203 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:38:31.253203 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:38:31.397460 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Start destroying the instance on the hypervisor. {{(pid=98967) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 26 10:38:31.425682 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:31.430017 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:31.434334 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b3acaa21-5d92-43e5-b365-754018bb6b97 req-103f5e6f-36d6-44c7-8c4a-52835c50fe0a service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Received event network-vif-unplugged-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:31.434549 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b3acaa21-5d92-43e5-b365-754018bb6b97 req-103f5e6f-36d6-44c7-8c4a-52835c50fe0a service nova] Acquiring lock "047061b2-340c-4cc9-899b-0744dad0081f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:31.434754 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b3acaa21-5d92-43e5-b365-754018bb6b97 req-103f5e6f-36d6-44c7-8c4a-52835c50fe0a service nova] Lock "047061b2-340c-4cc9-899b-0744dad0081f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:31.434927 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b3acaa21-5d92-43e5-b365-754018bb6b97 req-103f5e6f-36d6-44c7-8c4a-52835c50fe0a service nova] Lock "047061b2-340c-4cc9-899b-0744dad0081f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:31.435116 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b3acaa21-5d92-43e5-b365-754018bb6b97 req-103f5e6f-36d6-44c7-8c4a-52835c50fe0a service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] No waiting events found dispatching network-vif-unplugged-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:31.435283 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-b3acaa21-5d92-43e5-b365-754018bb6b97 req-103f5e6f-36d6-44c7-8c4a-52835c50fe0a service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Received unexpected event network-vif-unplugged-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 for instance with vm_state rescued and task_state unrescuing. Jun 26 10:38:31.435622 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b3acaa21-5d92-43e5-b365-754018bb6b97 req-103f5e6f-36d6-44c7-8c4a-52835c50fe0a service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Received event network-vif-plugged-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:31.436964 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b3acaa21-5d92-43e5-b365-754018bb6b97 req-103f5e6f-36d6-44c7-8c4a-52835c50fe0a service nova] Acquiring lock "047061b2-340c-4cc9-899b-0744dad0081f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:31.436964 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b3acaa21-5d92-43e5-b365-754018bb6b97 req-103f5e6f-36d6-44c7-8c4a-52835c50fe0a service nova] Lock "047061b2-340c-4cc9-899b-0744dad0081f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:31.440426 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b3acaa21-5d92-43e5-b365-754018bb6b97 req-103f5e6f-36d6-44c7-8c4a-52835c50fe0a service nova] Lock "047061b2-340c-4cc9-899b-0744dad0081f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:31.440426 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b3acaa21-5d92-43e5-b365-754018bb6b97 req-103f5e6f-36d6-44c7-8c4a-52835c50fe0a service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] No waiting events found dispatching network-vif-plugged-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:31.440426 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-b3acaa21-5d92-43e5-b365-754018bb6b97 req-103f5e6f-36d6-44c7-8c4a-52835c50fe0a service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Received unexpected event network-vif-plugged-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 for instance with vm_state rescued and task_state unrescuing. Jun 26 10:38:31.440426 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b3acaa21-5d92-43e5-b365-754018bb6b97 req-103f5e6f-36d6-44c7-8c4a-52835c50fe0a service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Received event network-vif-plugged-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:31.440426 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b3acaa21-5d92-43e5-b365-754018bb6b97 req-103f5e6f-36d6-44c7-8c4a-52835c50fe0a service nova] Acquiring lock "047061b2-340c-4cc9-899b-0744dad0081f-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:31.440426 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b3acaa21-5d92-43e5-b365-754018bb6b97 req-103f5e6f-36d6-44c7-8c4a-52835c50fe0a service nova] Lock "047061b2-340c-4cc9-899b-0744dad0081f-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:31.440426 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b3acaa21-5d92-43e5-b365-754018bb6b97 req-103f5e6f-36d6-44c7-8c4a-52835c50fe0a service nova] Lock "047061b2-340c-4cc9-899b-0744dad0081f-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:31.440426 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b3acaa21-5d92-43e5-b365-754018bb6b97 req-103f5e6f-36d6-44c7-8c4a-52835c50fe0a service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] No waiting events found dispatching network-vif-plugged-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:31.440426 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-b3acaa21-5d92-43e5-b365-754018bb6b97 req-103f5e6f-36d6-44c7-8c4a-52835c50fe0a service nova] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Received unexpected event network-vif-plugged-d8b51bcb-01d0-46b9-a5ff-b3335f560c00 for instance with vm_state rescued and task_state unrescuing. Jun 26 10:38:31.457671 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:31.462288 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:31.492532 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:31.499956 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:31.514477 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:38:31.522358 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Removed pending STOPPED event for 047061b2-340c-4cc9-899b-0744dad0081f due to new event Resumed> {{(pid=98967) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 26 10:38:31.522490 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:38:31.522610 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] VM Resumed (Lifecycle Event) Jun 26 10:38:31.525114 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-2171e2b4-ef8b-4d2a-b836-d40e9042f9ec tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:31.555249 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:31.566485 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:31.642405 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:31.650163 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:31.681368 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:31.723722 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:31.729357 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:31.733895 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-e85ec03c-ccad-4ea1-855b-611efc061034 req-c7103fab-1329-44da-968d-b33b4f9f8503 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-unplugged-38973918-1218-4531-8941-0e9fbff30e3e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:31.733895 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-e85ec03c-ccad-4ea1-855b-611efc061034 req-c7103fab-1329-44da-968d-b33b4f9f8503 service nova] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:31.734565 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-e85ec03c-ccad-4ea1-855b-611efc061034 req-c7103fab-1329-44da-968d-b33b4f9f8503 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:31.734565 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-e85ec03c-ccad-4ea1-855b-611efc061034 req-c7103fab-1329-44da-968d-b33b4f9f8503 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:31.734565 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-e85ec03c-ccad-4ea1-855b-611efc061034 req-c7103fab-1329-44da-968d-b33b4f9f8503 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] No waiting events found dispatching network-vif-unplugged-38973918-1218-4531-8941-0e9fbff30e3e {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:31.734713 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-e85ec03c-ccad-4ea1-855b-611efc061034 req-c7103fab-1329-44da-968d-b33b4f9f8503 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-unplugged-38973918-1218-4531-8941-0e9fbff30e3e for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:38:31.772933 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:31.795060 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:31.812382 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:31.815434 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:31.928865 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:31.968336 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.019873 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.022722 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.572s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:32.027576 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Start building networks asynchronously for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 26 10:38:32.031424 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:32.051418 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:38:32.059479 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Instance destroyed successfully. Jun 26 10:38:32.060408 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lazy-loading 'resources' on Instance uuid a686feac-bebe-47c8-a3c8-f3c2260ca7f5 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:32.202522 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-03d5982c-d74c-40b4-b854-1b7e1e857142 req-eb4f0795-5f9f-49c5-9d14-020482a77339 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-unplugged-99b479ce-38b6-464c-a476-7039543e31d9 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:32.202684 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-03d5982c-d74c-40b4-b854-1b7e1e857142 req-eb4f0795-5f9f-49c5-9d14-020482a77339 service nova] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:32.202921 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-03d5982c-d74c-40b4-b854-1b7e1e857142 req-eb4f0795-5f9f-49c5-9d14-020482a77339 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:32.203137 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-03d5982c-d74c-40b4-b854-1b7e1e857142 req-eb4f0795-5f9f-49c5-9d14-020482a77339 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:32.203137 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-03d5982c-d74c-40b4-b854-1b7e1e857142 req-eb4f0795-5f9f-49c5-9d14-020482a77339 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] No waiting events found dispatching network-vif-unplugged-99b479ce-38b6-464c-a476-7039543e31d9 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:32.203225 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-03d5982c-d74c-40b4-b854-1b7e1e857142 req-eb4f0795-5f9f-49c5-9d14-020482a77339 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-unplugged-99b479ce-38b6-464c-a476-7039543e31d9 for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:38:32.362870 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.415543 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.534882 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Allocating IP information in the background. {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 26 10:38:32.535039 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] allocate_for_instance() {{(pid=98967) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 26 10:38:32.535250 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:32.535481 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:32.556653 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:38:32.556653 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] VM Started (Lifecycle Event) Jun 26 10:38:32.563927 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-589050877',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-589050877',id=8,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOB2Sn7n/w8UeynSgIX7Pa+jWvACxe6vAPkjQBXv/eHuOpw0qYDCymYoGIWFIQ1K6gbGfZ4Mmn8WWEpLTsNoltBKnNPktYyulDt6E7QX9Q7av35lOxeQlHvrWEPuUtCAkg==',key_name='tempest-keypair-1634372885',keypairs=,launch_index=0,launched_at=2026-06-26T10:37:43Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='93df6885279b4537969fc0d1beb9f198',ramdisk_id='',reservation_id='r-wpod5h0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1397657593',owner_user_name='tempest-TaggedBootDevicesTest-1397657593-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-26T10:37:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a089dde66194b5b967cb79918aa1a33',uuid=a686feac-bebe-47c8-a3c8-f3c2260ca7f5,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "38973918-1218-4531-8941-0e9fbff30e3e", "address": "fa:16:3e:98:a5:6d", "network": {"id": "cc7daed3-e035-41b4-99f9-fb4b79e0045d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1956118171-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38973918-12", "ovs_interfaceid": "38973918-1218-4531-8941-0e9fbff30e3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 26 10:38:32.564304 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converting VIF {"id": "38973918-1218-4531-8941-0e9fbff30e3e", "address": "fa:16:3e:98:a5:6d", "network": {"id": "cc7daed3-e035-41b4-99f9-fb4b79e0045d", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest-1956118171-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.168", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap38973918-12", "ovs_interfaceid": "38973918-1218-4531-8941-0e9fbff30e3e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:38:32.564698 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:98:a5:6d,bridge_name='br-int',has_traffic_filtering=True,id=38973918-1218-4531-8941-0e9fbff30e3e,network=Network(cc7daed3-e035-41b4-99f9-fb4b79e0045d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38973918-12') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:38:32.564969 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:a5:6d,bridge_name='br-int',has_traffic_filtering=True,id=38973918-1218-4531-8941-0e9fbff30e3e,network=Network(cc7daed3-e035-41b4-99f9-fb4b79e0045d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38973918-12') {{(pid=98967) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 26 10:38:32.566544 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.566685 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap38973918-12, bridge=br-int, if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:32.567806 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.569457 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:32.603167 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.604342 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.604506 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8a4b0c2c-93c1-43c5-a98e-aa7d0fe7fca8) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:32.605165 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.605631 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:32.634410 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.636585 np0000003731 nova-compute[98967]: INFO os_vif [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:98:a5:6d,bridge_name='br-int',has_traffic_filtering=True,id=38973918-1218-4531-8941-0e9fbff30e3e,network=Network(cc7daed3-e035-41b4-99f9-fb4b79e0045d),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap38973918-12') Jun 26 10:38:32.637508 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-589050877',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-589050877',id=8,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOB2Sn7n/w8UeynSgIX7Pa+jWvACxe6vAPkjQBXv/eHuOpw0qYDCymYoGIWFIQ1K6gbGfZ4Mmn8WWEpLTsNoltBKnNPktYyulDt6E7QX9Q7av35lOxeQlHvrWEPuUtCAkg==',key_name='tempest-keypair-1634372885',keypairs=,launch_index=0,launched_at=2026-06-26T10:37:43Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='93df6885279b4537969fc0d1beb9f198',ramdisk_id='',reservation_id='r-wpod5h0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1397657593',owner_user_name='tempest-TaggedBootDevicesTest-1397657593-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-26T10:37:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a089dde66194b5b967cb79918aa1a33',uuid=a686feac-bebe-47c8-a3c8-f3c2260ca7f5,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "99b479ce-38b6-464c-a476-7039543e31d9", "address": "fa:16:3e:9b:2a:95", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b479ce-38", "ovs_interfaceid": "99b479ce-38b6-464c-a476-7039543e31d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98967) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 26 10:38:32.638172 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converting VIF {"id": "99b479ce-38b6-464c-a476-7039543e31d9", "address": "fa:16:3e:9b:2a:95", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.70", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap99b479ce-38", "ovs_interfaceid": "99b479ce-38b6-464c-a476-7039543e31d9", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:38:32.638835 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9b:2a:95,bridge_name='br-int',has_traffic_filtering=True,id=99b479ce-38b6-464c-a476-7039543e31d9,network=Network(7f72f742-9acd-4d6e-881e-fcc3b2713b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap99b479ce-38') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:38:32.639328 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:2a:95,bridge_name='br-int',has_traffic_filtering=True,id=99b479ce-38b6-464c-a476-7039543e31d9,network=Network(7f72f742-9acd-4d6e-881e-fcc3b2713b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap99b479ce-38') {{(pid=98967) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 26 10:38:32.640728 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.641062 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap99b479ce-38, bridge=br-int, if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:32.642238 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.643108 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:32.671761 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.675486 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.675868 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=bed22f9f-b69a-4b84-b4da-b8d17bef6cd5) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:32.676544 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.677156 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:32.696194 np0000003731 nova-compute[98967]: DEBUG nova.policy [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8a8a0b0240a34fb0bcf62ee7ec259cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2798faed447838b6c87f6d15cce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98967) authorize /opt/stack/nova/nova/policy.py:192}} Jun 26 10:38:32.704705 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.706830 np0000003731 nova-compute[98967]: INFO os_vif [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9b:2a:95,bridge_name='br-int',has_traffic_filtering=True,id=99b479ce-38b6-464c-a476-7039543e31d9,network=Network(7f72f742-9acd-4d6e-881e-fcc3b2713b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tap99b479ce-38') Jun 26 10:38:32.707505 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-589050877',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-589050877',id=8,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOB2Sn7n/w8UeynSgIX7Pa+jWvACxe6vAPkjQBXv/eHuOpw0qYDCymYoGIWFIQ1K6gbGfZ4Mmn8WWEpLTsNoltBKnNPktYyulDt6E7QX9Q7av35lOxeQlHvrWEPuUtCAkg==',key_name='tempest-keypair-1634372885',keypairs=,launch_index=0,launched_at=2026-06-26T10:37:43Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='93df6885279b4537969fc0d1beb9f198',ramdisk_id='',reservation_id='r-wpod5h0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1397657593',owner_user_name='tempest-TaggedBootDevicesTest-1397657593-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-26T10:37:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a089dde66194b5b967cb79918aa1a33',uuid=a686feac-bebe-47c8-a3c8-f3c2260ca7f5,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "a8a13bff-3694-4c1e-a5ae-486d72b71662", "address": "fa:16:3e:0d:e8:58", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a13bff-36", "ovs_interfaceid": "a8a13bff-3694-4c1e-a5ae-486d72b71662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98967) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 26 10:38:32.708625 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converting VIF {"id": "a8a13bff-3694-4c1e-a5ae-486d72b71662", "address": "fa:16:3e:0d:e8:58", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.187", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapa8a13bff-36", "ovs_interfaceid": "a8a13bff-3694-4c1e-a5ae-486d72b71662", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:38:32.709385 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0d:e8:58,bridge_name='br-int',has_traffic_filtering=True,id=a8a13bff-3694-4c1e-a5ae-486d72b71662,network=Network(7f72f742-9acd-4d6e-881e-fcc3b2713b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa8a13bff-36') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:38:32.709587 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:e8:58,bridge_name='br-int',has_traffic_filtering=True,id=a8a13bff-3694-4c1e-a5ae-486d72b71662,network=Network(7f72f742-9acd-4d6e-881e-fcc3b2713b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa8a13bff-36') {{(pid=98967) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 26 10:38:32.712846 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.713014 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapa8a13bff-36, bridge=br-int, if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:32.714155 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.715171 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:32.738817 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.739395 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.739555 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=81708dd1-421e-4cdb-8597-d4e661c8db34) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:32.740514 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.741566 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:32.763803 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.766036 np0000003731 nova-compute[98967]: INFO os_vif [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0d:e8:58,bridge_name='br-int',has_traffic_filtering=True,id=a8a13bff-3694-4c1e-a5ae-486d72b71662,network=Network(7f72f742-9acd-4d6e-881e-fcc3b2713b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapa8a13bff-36') Jun 26 10:38:32.766996 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-589050877',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-589050877',id=8,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOB2Sn7n/w8UeynSgIX7Pa+jWvACxe6vAPkjQBXv/eHuOpw0qYDCymYoGIWFIQ1K6gbGfZ4Mmn8WWEpLTsNoltBKnNPktYyulDt6E7QX9Q7av35lOxeQlHvrWEPuUtCAkg==',key_name='tempest-keypair-1634372885',keypairs=,launch_index=0,launched_at=2026-06-26T10:37:43Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='93df6885279b4537969fc0d1beb9f198',ramdisk_id='',reservation_id='r-wpod5h0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1397657593',owner_user_name='tempest-TaggedBootDevicesTest-1397657593-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-26T10:37:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a089dde66194b5b967cb79918aa1a33',uuid=a686feac-bebe-47c8-a3c8-f3c2260ca7f5,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "f141a8bb-5a71-4872-b62f-9fce6052875a", "address": "fa:16:3e:89:3b:98", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf141a8bb-5a", "ovs_interfaceid": "f141a8bb-5a71-4872-b62f-9fce6052875a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 26 10:38:32.767248 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converting VIF {"id": "f141a8bb-5a71-4872-b62f-9fce6052875a", "address": "fa:16:3e:89:3b:98", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.45", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapf141a8bb-5a", "ovs_interfaceid": "f141a8bb-5a71-4872-b62f-9fce6052875a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:38:32.768023 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:89:3b:98,bridge_name='br-int',has_traffic_filtering=True,id=f141a8bb-5a71-4872-b62f-9fce6052875a,network=Network(7f72f742-9acd-4d6e-881e-fcc3b2713b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf141a8bb-5a') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:38:32.768150 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:3b:98,bridge_name='br-int',has_traffic_filtering=True,id=f141a8bb-5a71-4872-b62f-9fce6052875a,network=Network(7f72f742-9acd-4d6e-881e-fcc3b2713b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf141a8bb-5a') {{(pid=98967) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 26 10:38:32.769256 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.769465 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapf141a8bb-5a, bridge=br-int, if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:32.770666 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.771783 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:32.794065 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.794065 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.794065 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=25183a4a-e640-4b43-be3d-42b71e033d67) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:32.794065 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.794451 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:32.810868 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.815745 np0000003731 nova-compute[98967]: INFO os_vif [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:89:3b:98,bridge_name='br-int',has_traffic_filtering=True,id=f141a8bb-5a71-4872-b62f-9fce6052875a,network=Network(7f72f742-9acd-4d6e-881e-fcc3b2713b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapf141a8bb-5a') Jun 26 10:38:32.816857 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-589050877',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-589050877',id=8,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOB2Sn7n/w8UeynSgIX7Pa+jWvACxe6vAPkjQBXv/eHuOpw0qYDCymYoGIWFIQ1K6gbGfZ4Mmn8WWEpLTsNoltBKnNPktYyulDt6E7QX9Q7av35lOxeQlHvrWEPuUtCAkg==',key_name='tempest-keypair-1634372885',keypairs=,launch_index=0,launched_at=2026-06-26T10:37:43Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='93df6885279b4537969fc0d1beb9f198',ramdisk_id='',reservation_id='r-wpod5h0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1397657593',owner_user_name='tempest-TaggedBootDevicesTest-1397657593-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-26T10:37:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a089dde66194b5b967cb79918aa1a33',uuid=a686feac-bebe-47c8-a3c8-f3c2260ca7f5,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fa54a649-79c1-4413-91b2-680216f8b045", "address": "fa:16:3e:4e:45:ca", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa54a649-79", "ovs_interfaceid": "fa54a649-79c1-4413-91b2-680216f8b045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 26 10:38:32.817199 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converting VIF {"id": "fa54a649-79c1-4413-91b2-680216f8b045", "address": "fa:16:3e:4e:45:ca", "network": {"id": "7f72f742-9acd-4d6e-881e-fcc3b2713b91", "bridge": "br-int", "label": "tempest-device-tagging-net1-1478240589", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.122", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfa54a649-79", "ovs_interfaceid": "fa54a649-79c1-4413-91b2-680216f8b045", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:38:32.817897 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4e:45:ca,bridge_name='br-int',has_traffic_filtering=True,id=fa54a649-79c1-4413-91b2-680216f8b045,network=Network(7f72f742-9acd-4d6e-881e-fcc3b2713b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa54a649-79') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:38:32.818230 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:45:ca,bridge_name='br-int',has_traffic_filtering=True,id=fa54a649-79c1-4413-91b2-680216f8b045,network=Network(7f72f742-9acd-4d6e-881e-fcc3b2713b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa54a649-79') {{(pid=98967) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 26 10:38:32.819255 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.819472 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfa54a649-79, bridge=br-int, if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:32.820564 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.821575 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:32.839024 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.842492 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.842731 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=91b5c4a9-4dae-425b-8036-7c4a29a45f46) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:32.846303 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.855955 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:32.864573 np0000003731 nova-compute[98967]: INFO os_vif [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4e:45:ca,bridge_name='br-int',has_traffic_filtering=True,id=fa54a649-79c1-4413-91b2-680216f8b045,network=Network(7f72f742-9acd-4d6e-881e-fcc3b2713b91),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfa54a649-79') Jun 26 10:38:32.865285 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-589050877',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-589050877',id=8,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOB2Sn7n/w8UeynSgIX7Pa+jWvACxe6vAPkjQBXv/eHuOpw0qYDCymYoGIWFIQ1K6gbGfZ4Mmn8WWEpLTsNoltBKnNPktYyulDt6E7QX9Q7av35lOxeQlHvrWEPuUtCAkg==',key_name='tempest-keypair-1634372885',keypairs=,launch_index=0,launched_at=2026-06-26T10:37:43Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='93df6885279b4537969fc0d1beb9f198',ramdisk_id='',reservation_id='r-wpod5h0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1397657593',owner_user_name='tempest-TaggedBootDevicesTest-1397657593-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-26T10:37:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a089dde66194b5b967cb79918aa1a33',uuid=a686feac-bebe-47c8-a3c8-f3c2260ca7f5,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a", "address": "fa:16:3e:fc:62:66", "network": {"id": "35589be9-ff77-40f5-8d6f-20e36bb2cd03", "bridge": "br-int", "label": "tempest-device-tagging-net2-1172567199", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0f4a94-bf", "ovs_interfaceid": "4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 26 10:38:32.865457 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converting VIF {"id": "4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a", "address": "fa:16:3e:fc:62:66", "network": {"id": "35589be9-ff77-40f5-8d6f-20e36bb2cd03", "bridge": "br-int", "label": "tempest-device-tagging-net2-1172567199", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap4d0f4a94-bf", "ovs_interfaceid": "4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:38:32.866568 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fc:62:66,bridge_name='br-int',has_traffic_filtering=True,id=4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a,network=Network(35589be9-ff77-40f5-8d6f-20e36bb2cd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d0f4a94-bf') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:38:32.866568 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:62:66,bridge_name='br-int',has_traffic_filtering=True,id=4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a,network=Network(35589be9-ff77-40f5-8d6f-20e36bb2cd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d0f4a94-bf') {{(pid=98967) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 26 10:38:32.867150 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.867443 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap4d0f4a94-bf, bridge=br-int, if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:32.870024 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.871264 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:32.876645 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.877743 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.878049 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=7ac01dee-57de-4be0-a5cd-cee8505624f4) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:32.879759 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.880423 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:32.886784 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.889198 np0000003731 nova-compute[98967]: INFO os_vif [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fc:62:66,bridge_name='br-int',has_traffic_filtering=True,id=4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a,network=Network(35589be9-ff77-40f5-8d6f-20e36bb2cd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap4d0f4a94-bf') Jun 26 10:38:32.889855 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:37:01Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-589050877',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-589050877',id=8,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOB2Sn7n/w8UeynSgIX7Pa+jWvACxe6vAPkjQBXv/eHuOpw0qYDCymYoGIWFIQ1K6gbGfZ4Mmn8WWEpLTsNoltBKnNPktYyulDt6E7QX9Q7av35lOxeQlHvrWEPuUtCAkg==',key_name='tempest-keypair-1634372885',keypairs=,launch_index=0,launched_at=2026-06-26T10:37:43Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='93df6885279b4537969fc0d1beb9f198',ramdisk_id='',reservation_id='r-wpod5h0g',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest-1397657593',owner_user_name='tempest-TaggedBootDevicesTest-1397657593-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-26T10:37:44Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a089dde66194b5b967cb79918aa1a33',uuid=a686feac-bebe-47c8-a3c8-f3c2260ca7f5,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "53ab7bb3-88bd-4061-9d43-b6392e20c003", "address": "fa:16:3e:50:56:3a", "network": {"id": "35589be9-ff77-40f5-8d6f-20e36bb2cd03", "bridge": "br-int", "label": "tempest-device-tagging-net2-1172567199", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ab7bb3-88", "ovs_interfaceid": "53ab7bb3-88bd-4061-9d43-b6392e20c003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 26 10:38:32.890028 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converting VIF {"id": "53ab7bb3-88bd-4061-9d43-b6392e20c003", "address": "fa:16:3e:50:56:3a", "network": {"id": "35589be9-ff77-40f5-8d6f-20e36bb2cd03", "bridge": "br-int", "label": "tempest-device-tagging-net2-1172567199", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "93df6885279b4537969fc0d1beb9f198", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap53ab7bb3-88", "ovs_interfaceid": "53ab7bb3-88bd-4061-9d43-b6392e20c003", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:38:32.890531 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:50:56:3a,bridge_name='br-int',has_traffic_filtering=True,id=53ab7bb3-88bd-4061-9d43-b6392e20c003,network=Network(35589be9-ff77-40f5-8d6f-20e36bb2cd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ab7bb3-88') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:38:32.891691 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:56:3a,bridge_name='br-int',has_traffic_filtering=True,id=53ab7bb3-88bd-4061-9d43-b6392e20c003,network=Network(35589be9-ff77-40f5-8d6f-20e36bb2cd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ab7bb3-88') {{(pid=98967) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 26 10:38:32.892657 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.892974 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap53ab7bb3-88, bridge=br-int, if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:32.895192 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.896586 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:32.897534 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.897779 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=50c7368c-90ac-4302-bef2-96d900594946) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:32.899791 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:32.900579 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:32.902372 np0000003731 nova-compute[98967]: INFO os_vif [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:50:56:3a,bridge_name='br-int',has_traffic_filtering=True,id=53ab7bb3-88bd-4061-9d43-b6392e20c003,network=Network(35589be9-ff77-40f5-8d6f-20e36bb2cd03),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap53ab7bb3-88') Jun 26 10:38:32.905661 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] calling os-brick to detach iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 26 10:38:32.906061 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020', 'iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3cb9f515-cb6e-4822-8208-4bd6694ad020', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:38:32.906242 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:38:32.906634 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:38:32.906981 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020', 'iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3cb9f515-cb6e-4822-8208-4bd6694ad020', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 10:38:32.907108 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020', 0)] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 10:38:32.948673 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:32.948673 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:32.948673 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:32.948673 np0000003731 nova-compute[98967]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:38:32.948673 np0000003731 nova-compute[98967]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:38:32.948673 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:32.948673 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:32.948673 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:32.948673 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:32.948673 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:32.948673 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:38:32.948673 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:32.948673 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:32.948673 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:32.948673 np0000003731 nova-compute[98967]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:38:32.948673 np0000003731 nova-compute[98967]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:38:32.948673 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:32.948673 np0000003731 nova-compute[98967]: tcp: [6] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:32.948673 np0000003731 nova-compute[98967]: tcp: [7] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020 (non-flash) Jun 26 10:38:32.948673 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:32.948673 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:32.948673 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:38:32.948673 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '2'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '3'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020', '6'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020', '7'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77', '9')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 10:38:32.948673 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020', '7')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:38:32.948673 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020', '6')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:38:32.950147 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Resulting device map defaultdict(. at 0x75f070662a20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020'): ({'sde'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020'): ({'sdd'}, set())}) {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 10:38:32.950147 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Removing multipathed devices sdd, sde {{(pid=98967) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 10:38:32.950147 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Flush multipath device 330000000e12a8a8b {{(pid=98967) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 26 10:38:33.022646 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:38:33.022646 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:33.038968 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 26 10:38:33.059918 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:33.061737 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 047061b2-340c-4cc9-899b-0744dad0081f] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:38:33.065633 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:38:33.124307 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 10:38:33.124524 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 10:38:33.126329 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 10:38:33.141290 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 10:38:33.141839 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020')] {{(pid=98967) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 10:38:33.154201 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:33.189332 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 7, target: iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020, portal: 192.168.40.100,3260] Jun 26 10:38:33.189332 np0000003731 nova-compute[98967]: Logout of [sid: 7, target: iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020, portal: 192.168.40.100,3260] successful. Jun 26 10:38:33.189332 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:33.225368 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:33.239724 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:33.286819 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 6, target: iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020, portal: 192.168.50.100,3260] Jun 26 10:38:33.286819 np0000003731 nova-compute[98967]: Logout of [sid: 6, target: iqn.2023-03.storpool.com:os--volume-3cb9f515-cb6e-4822-8208-4bd6694ad020, portal: 192.168.50.100,3260] successful. Jun 26 10:38:33.286819 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:33.292501 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:33.293709 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.386s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:38:33.293709 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] <== disconnect_volume: return (386ms) None {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:38:33.293709 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Disconnected iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 26 10:38:33.294033 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] calling os-brick to detach iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 26 10:38:33.294799 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77', 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1b0b898b-40b8-40fe-84eb-0361ea0aaf77', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:38:33.294799 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:38:33.294799 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:38:33.294916 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77', 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1b0b898b-40b8-40fe-84eb-0361ea0aaf77', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 10:38:33.295085 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77', 0)] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 10:38:33.337640 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:33.337640 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:33.337640 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:33.337640 np0000003731 nova-compute[98967]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:38:33.337640 np0000003731 nova-compute[98967]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:38:33.337640 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:33.337640 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:33.337640 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:33.337640 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:38:33.338021 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:33.338021 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:33.338021 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:33.338021 np0000003731 nova-compute[98967]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:38:33.338021 np0000003731 nova-compute[98967]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:38:33.338021 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:33.338021 np0000003731 nova-compute[98967]: tcp: [8] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:33.338021 np0000003731 nova-compute[98967]: tcp: [9] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77 (non-flash) Jun 26 10:38:33.338021 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:38:33.338021 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '2'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77', '8'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77', '9')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 10:38:33.338345 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77', '8')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:38:33.339080 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77', '9')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:38:33.339907 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Resulting device map defaultdict(. at 0x75f070662a20>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77'): ({'sdg'}, set())}) {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 10:38:33.340120 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Removing multipathed devices sdf, sdg {{(pid=98967) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 10:38:33.341003 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Flush multipath device 3300000007bcfada4 {{(pid=98967) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 26 10:38:33.375202 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:38:33.451539 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:38:33.489570 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 10:38:33.489881 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 10:38:33.490723 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 10:38:33.502474 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 10:38:33.502674 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77')] {{(pid=98967) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 10:38:33.514561 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-acfb4712-aa2a-4e89-a0f5-55e8f358cc4a req-adfcf83a-6515-4227-b0b8-b94c5f43b5b6 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-unplugged-f141a8bb-5a71-4872-b62f-9fce6052875a {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:33.515903 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-acfb4712-aa2a-4e89-a0f5-55e8f358cc4a req-adfcf83a-6515-4227-b0b8-b94c5f43b5b6 service nova] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:33.516108 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-acfb4712-aa2a-4e89-a0f5-55e8f358cc4a req-adfcf83a-6515-4227-b0b8-b94c5f43b5b6 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:33.516249 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-acfb4712-aa2a-4e89-a0f5-55e8f358cc4a req-adfcf83a-6515-4227-b0b8-b94c5f43b5b6 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:33.516357 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-acfb4712-aa2a-4e89-a0f5-55e8f358cc4a req-adfcf83a-6515-4227-b0b8-b94c5f43b5b6 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] No waiting events found dispatching network-vif-unplugged-f141a8bb-5a71-4872-b62f-9fce6052875a {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:33.516456 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-acfb4712-aa2a-4e89-a0f5-55e8f358cc4a req-adfcf83a-6515-4227-b0b8-b94c5f43b5b6 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-unplugged-f141a8bb-5a71-4872-b62f-9fce6052875a for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:38:33.516553 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-acfb4712-aa2a-4e89-a0f5-55e8f358cc4a req-adfcf83a-6515-4227-b0b8-b94c5f43b5b6 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-unplugged-f141a8bb-5a71-4872-b62f-9fce6052875a {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:33.516655 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-acfb4712-aa2a-4e89-a0f5-55e8f358cc4a req-adfcf83a-6515-4227-b0b8-b94c5f43b5b6 service nova] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:33.516754 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-acfb4712-aa2a-4e89-a0f5-55e8f358cc4a req-adfcf83a-6515-4227-b0b8-b94c5f43b5b6 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:33.517167 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-acfb4712-aa2a-4e89-a0f5-55e8f358cc4a req-adfcf83a-6515-4227-b0b8-b94c5f43b5b6 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:33.517307 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-acfb4712-aa2a-4e89-a0f5-55e8f358cc4a req-adfcf83a-6515-4227-b0b8-b94c5f43b5b6 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] No waiting events found dispatching network-vif-unplugged-f141a8bb-5a71-4872-b62f-9fce6052875a {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:33.517413 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-acfb4712-aa2a-4e89-a0f5-55e8f358cc4a req-adfcf83a-6515-4227-b0b8-b94c5f43b5b6 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-unplugged-f141a8bb-5a71-4872-b62f-9fce6052875a for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:38:33.518253 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:33.545152 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Start building block device mappings for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 26 10:38:33.561069 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 8, target: iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77, portal: 192.168.40.100,3260] Jun 26 10:38:33.561069 np0000003731 nova-compute[98967]: Logout of [sid: 8, target: iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77, portal: 192.168.40.100,3260] successful. Jun 26 10:38:33.561069 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:33.564362 np0000003731 nova-compute[98967]: DEBUG nova.utils [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Queued Task(fn=>, remaining_delay=14.999701467000023 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:33.583123 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:33.602875 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:33.642472 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 9, target: iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77, portal: 192.168.50.100,3260] Jun 26 10:38:33.642472 np0000003731 nova-compute[98967]: Logout of [sid: 9, target: iqn.2023-03.storpool.com:os--volume-1b0b898b-40b8-40fe-84eb-0361ea0aaf77, portal: 192.168.50.100,3260] successful. Jun 26 10:38:33.642472 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:33.658455 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:33.658708 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.364s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:38:33.658860 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] <== disconnect_volume: return (364ms) None {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:38:33.659033 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Disconnected iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 26 10:38:33.660058 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] calling os-brick to detach iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 26 10:38:33.660364 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4', 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f6728418-9234-41c7-befe-b38ee3265ba4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:38:33.660549 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:38:33.660991 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:38:33.661328 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4', 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f6728418-9234-41c7-befe-b38ee3265ba4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 10:38:33.661478 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4', 0)] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 10:38:33.690904 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:33.690904 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:33.690904 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:33.690904 np0000003731 nova-compute[98967]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:38:33.690904 np0000003731 nova-compute[98967]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:38:33.690904 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:33.690904 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:38:33.691968 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsi session list stdout=tcp: [10] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:33.691968 np0000003731 nova-compute[98967]: tcp: [11] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4 (non-flash) Jun 26 10:38:33.691968 np0000003731 nova-compute[98967]: tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:33.691968 np0000003731 nova-compute[98967]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:38:33.691968 np0000003731 nova-compute[98967]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:38:33.691968 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:38:33.691968 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:38:33.692255 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4', '10'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4', '11'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '2'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de', '21'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '3')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 10:38:33.692410 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4', '10')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:38:33.696362 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4', '11')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:38:33.697671 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Resulting device map defaultdict(. at 0x75f07065f1a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4'): ({'sdh'}, set())}) {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 10:38:33.698311 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Removing multipathed devices sdh, sdi {{(pid=98967) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 10:38:33.698544 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Flush multipath device 3300000009ac11a9d {{(pid=98967) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 26 10:38:33.725300 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Successfully created port: 061a7108-6f47-4def-b12d-38eb13d382f6 {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:38:33.754111 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:38:33.793067 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:38:33.835307 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 10:38:33.835465 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 10:38:33.836425 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 10:38:33.846727 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 10:38:33.846892 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4')] {{(pid=98967) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 10:38:33.857938 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:33.896095 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-07e97a3b-5a51-42e8-a6a1-f27bd970cb3e req-94d33118-eb91-422a-8d2a-b1605128f8ae service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-unplugged-a8a13bff-3694-4c1e-a5ae-486d72b71662 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-07e97a3b-5a51-42e8-a6a1-f27bd970cb3e req-94d33118-eb91-422a-8d2a-b1605128f8ae service nova] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-07e97a3b-5a51-42e8-a6a1-f27bd970cb3e req-94d33118-eb91-422a-8d2a-b1605128f8ae service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-07e97a3b-5a51-42e8-a6a1-f27bd970cb3e req-94d33118-eb91-422a-8d2a-b1605128f8ae service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-07e97a3b-5a51-42e8-a6a1-f27bd970cb3e req-94d33118-eb91-422a-8d2a-b1605128f8ae service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] No waiting events found dispatching network-vif-unplugged-a8a13bff-3694-4c1e-a5ae-486d72b71662 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-07e97a3b-5a51-42e8-a6a1-f27bd970cb3e req-94d33118-eb91-422a-8d2a-b1605128f8ae service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-unplugged-a8a13bff-3694-4c1e-a5ae-486d72b71662 for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-f7fba4ad-5732-4857-aa5e-5bec8d54f32b req-382b7f9e-5940-49c4-8a96-fd161c6c7104 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-unplugged-38973918-1218-4531-8941-0e9fbff30e3e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-f7fba4ad-5732-4857-aa5e-5bec8d54f32b req-382b7f9e-5940-49c4-8a96-fd161c6c7104 service nova] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-f7fba4ad-5732-4857-aa5e-5bec8d54f32b req-382b7f9e-5940-49c4-8a96-fd161c6c7104 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-f7fba4ad-5732-4857-aa5e-5bec8d54f32b req-382b7f9e-5940-49c4-8a96-fd161c6c7104 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-f7fba4ad-5732-4857-aa5e-5bec8d54f32b req-382b7f9e-5940-49c4-8a96-fd161c6c7104 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] No waiting events found dispatching network-vif-unplugged-38973918-1218-4531-8941-0e9fbff30e3e {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-f7fba4ad-5732-4857-aa5e-5bec8d54f32b req-382b7f9e-5940-49c4-8a96-fd161c6c7104 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-unplugged-38973918-1218-4531-8941-0e9fbff30e3e for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-f7fba4ad-5732-4857-aa5e-5bec8d54f32b req-382b7f9e-5940-49c4-8a96-fd161c6c7104 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-unplugged-4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-f7fba4ad-5732-4857-aa5e-5bec8d54f32b req-382b7f9e-5940-49c4-8a96-fd161c6c7104 service nova] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-f7fba4ad-5732-4857-aa5e-5bec8d54f32b req-382b7f9e-5940-49c4-8a96-fd161c6c7104 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.003s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-f7fba4ad-5732-4857-aa5e-5bec8d54f32b req-382b7f9e-5940-49c4-8a96-fd161c6c7104 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-f7fba4ad-5732-4857-aa5e-5bec8d54f32b req-382b7f9e-5940-49c4-8a96-fd161c6c7104 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] No waiting events found dispatching network-vif-unplugged-4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-f7fba4ad-5732-4857-aa5e-5bec8d54f32b req-382b7f9e-5940-49c4-8a96-fd161c6c7104 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-unplugged-4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-f7fba4ad-5732-4857-aa5e-5bec8d54f32b req-382b7f9e-5940-49c4-8a96-fd161c6c7104 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-unplugged-4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-f7fba4ad-5732-4857-aa5e-5bec8d54f32b req-382b7f9e-5940-49c4-8a96-fd161c6c7104 service nova] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-f7fba4ad-5732-4857-aa5e-5bec8d54f32b req-382b7f9e-5940-49c4-8a96-fd161c6c7104 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-f7fba4ad-5732-4857-aa5e-5bec8d54f32b req-382b7f9e-5940-49c4-8a96-fd161c6c7104 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-f7fba4ad-5732-4857-aa5e-5bec8d54f32b req-382b7f9e-5940-49c4-8a96-fd161c6c7104 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] No waiting events found dispatching network-vif-unplugged-4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-f7fba4ad-5732-4857-aa5e-5bec8d54f32b req-382b7f9e-5940-49c4-8a96-fd161c6c7104 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-unplugged-4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-f7fba4ad-5732-4857-aa5e-5bec8d54f32b req-382b7f9e-5940-49c4-8a96-fd161c6c7104 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-unplugged-fa54a649-79c1-4413-91b2-680216f8b045 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-f7fba4ad-5732-4857-aa5e-5bec8d54f32b req-382b7f9e-5940-49c4-8a96-fd161c6c7104 service nova] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-f7fba4ad-5732-4857-aa5e-5bec8d54f32b req-382b7f9e-5940-49c4-8a96-fd161c6c7104 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-f7fba4ad-5732-4857-aa5e-5bec8d54f32b req-382b7f9e-5940-49c4-8a96-fd161c6c7104 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-f7fba4ad-5732-4857-aa5e-5bec8d54f32b req-382b7f9e-5940-49c4-8a96-fd161c6c7104 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] No waiting events found dispatching network-vif-unplugged-fa54a649-79c1-4413-91b2-680216f8b045 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-f7fba4ad-5732-4857-aa5e-5bec8d54f32b req-382b7f9e-5940-49c4-8a96-fd161c6c7104 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-unplugged-fa54a649-79c1-4413-91b2-680216f8b045 for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-f7fba4ad-5732-4857-aa5e-5bec8d54f32b req-382b7f9e-5940-49c4-8a96-fd161c6c7104 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-unplugged-fa54a649-79c1-4413-91b2-680216f8b045 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-f7fba4ad-5732-4857-aa5e-5bec8d54f32b req-382b7f9e-5940-49c4-8a96-fd161c6c7104 service nova] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-f7fba4ad-5732-4857-aa5e-5bec8d54f32b req-382b7f9e-5940-49c4-8a96-fd161c6c7104 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-f7fba4ad-5732-4857-aa5e-5bec8d54f32b req-382b7f9e-5940-49c4-8a96-fd161c6c7104 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:33.927447 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-f7fba4ad-5732-4857-aa5e-5bec8d54f32b req-382b7f9e-5940-49c4-8a96-fd161c6c7104 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] No waiting events found dispatching network-vif-unplugged-fa54a649-79c1-4413-91b2-680216f8b045 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:33.928577 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-f7fba4ad-5732-4857-aa5e-5bec8d54f32b req-382b7f9e-5940-49c4-8a96-fd161c6c7104 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-unplugged-fa54a649-79c1-4413-91b2-680216f8b045 for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:38:33.928577 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 10, target: iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4, portal: 192.168.40.100,3260] Jun 26 10:38:33.928577 np0000003731 nova-compute[98967]: Logout of [sid: 10, target: iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4, portal: 192.168.40.100,3260] successful. Jun 26 10:38:33.928577 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:33.969291 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:33.972000 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:34.009213 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 11, target: iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4, portal: 192.168.50.100,3260] Jun 26 10:38:34.009213 np0000003731 nova-compute[98967]: Logout of [sid: 11, target: iqn.2023-03.storpool.com:os--volume-f6728418-9234-41c7-befe-b38ee3265ba4, portal: 192.168.50.100,3260] successful. Jun 26 10:38:34.009213 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:34.029394 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:38:34.029394 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.365s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:38:34.029394 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] <== disconnect_volume: return (365ms) None {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:38:34.029394 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Disconnected iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 26 10:38:34.029394 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Deleting instance files /opt/stack/data/nova/instances/a686feac-bebe-47c8-a3c8-f3c2260ca7f5_del Jun 26 10:38:34.029394 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Deletion of /opt/stack/data/nova/instances/a686feac-bebe-47c8-a3c8-f3c2260ca7f5_del complete Jun 26 10:38:34.287155 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-a4c6ad1f-56a7-4a00-ad0e-b23762332585 req-8f58ee29-137c-43e3-b1ec-ebc4aa1aae8c service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-unplugged-99b479ce-38b6-464c-a476-7039543e31d9 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:34.291220 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-a4c6ad1f-56a7-4a00-ad0e-b23762332585 req-8f58ee29-137c-43e3-b1ec-ebc4aa1aae8c service nova] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:34.291220 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-a4c6ad1f-56a7-4a00-ad0e-b23762332585 req-8f58ee29-137c-43e3-b1ec-ebc4aa1aae8c service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:34.291220 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-a4c6ad1f-56a7-4a00-ad0e-b23762332585 req-8f58ee29-137c-43e3-b1ec-ebc4aa1aae8c service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:34.291220 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-a4c6ad1f-56a7-4a00-ad0e-b23762332585 req-8f58ee29-137c-43e3-b1ec-ebc4aa1aae8c service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] No waiting events found dispatching network-vif-unplugged-99b479ce-38b6-464c-a476-7039543e31d9 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:34.291220 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-a4c6ad1f-56a7-4a00-ad0e-b23762332585 req-8f58ee29-137c-43e3-b1ec-ebc4aa1aae8c service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-unplugged-99b479ce-38b6-464c-a476-7039543e31d9 for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:38:34.534037 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Took 3.14 seconds to destroy the instance on the hypervisor. Jun 26 10:38:34.534648 np0000003731 nova-compute[98967]: DEBUG oslo.service.backend._common.loopingcall [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98967) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 26 10:38:34.534978 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [-] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Deallocating network for instance {{(pid=98967) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 26 10:38:34.535169 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [-] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] deallocate_for_instance() {{(pid=98967) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 26 10:38:34.535314 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:34.553122 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Start spawning the instance on the hypervisor. {{(pid=98967) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 26 10:38:34.555028 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Creating instance directory {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 26 10:38:34.555028 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Creating image(s) Jun 26 10:38:34.555028 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "/opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:34.555297 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "/opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:34.555902 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "/opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:34.556534 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:34.559353 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:34.560807 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:34.660361 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.099s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:34.660837 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:34.661440 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:34.662065 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:34.664876 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:34.665157 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:34.721304 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:34.770763 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.088s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:34.770763 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk 1073741824 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:34.859566 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Successfully updated port: 061a7108-6f47-4def-b12d-38eb13d382f6 {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:38:34.881485 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk 1073741824" returned: 0 in 0.111s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:34.881485 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.204s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:34.881485 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:34.951314 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.083s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:34.951314 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk. size=1073741824 {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 26 10:38:34.951314 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:35.044033 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:35.044477 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Cannot resize image /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk to a smaller size. {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 26 10:38:35.044833 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Created local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 26 10:38:35.045040 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Ensure instance console log exists: /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/console.log {{(pid=98967) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 26 10:38:35.045298 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:35.045514 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:35.045646 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:35.360237 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "refresh_cache-c1043abd-b0c0-439e-b065-8bef627483cb" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:38:35.360320 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquired lock "refresh_cache-c1043abd-b0c0-439e-b065-8bef627483cb" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:38:35.360533 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:38:35.884479 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:35.884835 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:35.988735 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:38:36.003271 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-18e9a6df-bc9b-4a3c-823b-d337fa26a5a9 req-c0f00da8-b06d-42bd-acbe-7ab2d1562e98 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-unplugged-a8a13bff-3694-4c1e-a5ae-486d72b71662 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:36.003271 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-18e9a6df-bc9b-4a3c-823b-d337fa26a5a9 req-c0f00da8-b06d-42bd-acbe-7ab2d1562e98 service nova] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:36.003271 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-18e9a6df-bc9b-4a3c-823b-d337fa26a5a9 req-c0f00da8-b06d-42bd-acbe-7ab2d1562e98 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:36.003271 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-18e9a6df-bc9b-4a3c-823b-d337fa26a5a9 req-c0f00da8-b06d-42bd-acbe-7ab2d1562e98 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:36.003271 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-18e9a6df-bc9b-4a3c-823b-d337fa26a5a9 req-c0f00da8-b06d-42bd-acbe-7ab2d1562e98 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] No waiting events found dispatching network-vif-unplugged-a8a13bff-3694-4c1e-a5ae-486d72b71662 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:36.003271 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-18e9a6df-bc9b-4a3c-823b-d337fa26a5a9 req-c0f00da8-b06d-42bd-acbe-7ab2d1562e98 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-unplugged-a8a13bff-3694-4c1e-a5ae-486d72b71662 for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:38:36.003271 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-18e9a6df-bc9b-4a3c-823b-d337fa26a5a9 req-c0f00da8-b06d-42bd-acbe-7ab2d1562e98 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-unplugged-53ab7bb3-88bd-4061-9d43-b6392e20c003 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:36.003271 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-18e9a6df-bc9b-4a3c-823b-d337fa26a5a9 req-c0f00da8-b06d-42bd-acbe-7ab2d1562e98 service nova] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:36.003271 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-18e9a6df-bc9b-4a3c-823b-d337fa26a5a9 req-c0f00da8-b06d-42bd-acbe-7ab2d1562e98 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:36.003271 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-18e9a6df-bc9b-4a3c-823b-d337fa26a5a9 req-c0f00da8-b06d-42bd-acbe-7ab2d1562e98 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:36.003271 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-18e9a6df-bc9b-4a3c-823b-d337fa26a5a9 req-c0f00da8-b06d-42bd-acbe-7ab2d1562e98 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] No waiting events found dispatching network-vif-unplugged-53ab7bb3-88bd-4061-9d43-b6392e20c003 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:36.003271 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-18e9a6df-bc9b-4a3c-823b-d337fa26a5a9 req-c0f00da8-b06d-42bd-acbe-7ab2d1562e98 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-unplugged-53ab7bb3-88bd-4061-9d43-b6392e20c003 for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:38:36.003271 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-18e9a6df-bc9b-4a3c-823b-d337fa26a5a9 req-c0f00da8-b06d-42bd-acbe-7ab2d1562e98 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-unplugged-53ab7bb3-88bd-4061-9d43-b6392e20c003 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:36.003271 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-18e9a6df-bc9b-4a3c-823b-d337fa26a5a9 req-c0f00da8-b06d-42bd-acbe-7ab2d1562e98 service nova] Acquiring lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:36.003271 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-18e9a6df-bc9b-4a3c-823b-d337fa26a5a9 req-c0f00da8-b06d-42bd-acbe-7ab2d1562e98 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:36.003271 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-18e9a6df-bc9b-4a3c-823b-d337fa26a5a9 req-c0f00da8-b06d-42bd-acbe-7ab2d1562e98 service nova] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:36.003271 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-18e9a6df-bc9b-4a3c-823b-d337fa26a5a9 req-c0f00da8-b06d-42bd-acbe-7ab2d1562e98 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] No waiting events found dispatching network-vif-unplugged-53ab7bb3-88bd-4061-9d43-b6392e20c003 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:36.003271 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-18e9a6df-bc9b-4a3c-823b-d337fa26a5a9 req-c0f00da8-b06d-42bd-acbe-7ab2d1562e98 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-unplugged-53ab7bb3-88bd-4061-9d43-b6392e20c003 for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:38:36.393799 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Starting instance... {{(pid=98967) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 26 10:38:36.405130 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-83c95d52-8720-4052-93ea-55df8763e0a2 req-2f9a3db4-1951-421f-8291-c425b0429942 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Received event network-changed-061a7108-6f47-4def-b12d-38eb13d382f6 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:36.405130 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-83c95d52-8720-4052-93ea-55df8763e0a2 req-2f9a3db4-1951-421f-8291-c425b0429942 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Refreshing instance network info cache due to event network-changed-061a7108-6f47-4def-b12d-38eb13d382f6. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:38:36.405130 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-83c95d52-8720-4052-93ea-55df8763e0a2 req-2f9a3db4-1951-421f-8291-c425b0429942 service nova] Acquiring lock "refresh_cache-c1043abd-b0c0-439e-b065-8bef627483cb" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:38:36.561797 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:36.759125 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Updating instance_info_cache with network_info: [{"id": "061a7108-6f47-4def-b12d-38eb13d382f6", "address": "fa:16:3e:48:bc:a4", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap061a7108-6f", "ovs_interfaceid": "061a7108-6f47-4def-b12d-38eb13d382f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:38:36.979252 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:36.979735 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:36.982741 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98967) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 26 10:38:36.983075 np0000003731 nova-compute[98967]: INFO nova.compute.claims [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Claim successful on node np0000003731 Jun 26 10:38:37.020032 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-0e0d4f09-12d4-49f8-bfa7-1ef5acaf2d9a req-ee6451ad-d304-4252-aa5c-e1e3028e395c service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-deleted-53ab7bb3-88bd-4061-9d43-b6392e20c003 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:37.020032 np0000003731 nova-compute[98967]: INFO nova.compute.manager [req-0e0d4f09-12d4-49f8-bfa7-1ef5acaf2d9a req-ee6451ad-d304-4252-aa5c-e1e3028e395c service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Neutron deleted interface 53ab7bb3-88bd-4061-9d43-b6392e20c003; detaching it from the instance and deleting it from the info cache Jun 26 10:38:37.020032 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-0e0d4f09-12d4-49f8-bfa7-1ef5acaf2d9a req-ee6451ad-d304-4252-aa5c-e1e3028e395c service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Detach interface failed, port_id=53ab7bb3-88bd-4061-9d43-b6392e20c003, reason: Instance a686feac-bebe-47c8-a3c8-f3c2260ca7f5 could not be found. {{(pid=98967) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 26 10:38:37.197581 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00044688599996334233 future=) submitted to {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:37.197710 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:37.198029 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=0.3836883840001519 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:37.198029 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=0.3835674399999789 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:37.199688 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Emitting event Stopped> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:38:37.199688 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] VM Stopped (Lifecycle Event) Jun 26 10:38:37.273805 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Releasing lock "refresh_cache-c1043abd-b0c0-439e-b065-8bef627483cb" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:38:37.273805 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Instance network_info: |[{"id": "061a7108-6f47-4def-b12d-38eb13d382f6", "address": "fa:16:3e:48:bc:a4", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap061a7108-6f", "ovs_interfaceid": "061a7108-6f47-4def-b12d-38eb13d382f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 26 10:38:37.273805 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-83c95d52-8720-4052-93ea-55df8763e0a2 req-2f9a3db4-1951-421f-8291-c425b0429942 service nova] Acquired lock "refresh_cache-c1043abd-b0c0-439e-b065-8bef627483cb" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:38:37.273805 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-83c95d52-8720-4052-93ea-55df8763e0a2 req-2f9a3db4-1951-421f-8291-c425b0429942 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Refreshing network info cache for port 061a7108-6f47-4def-b12d-38eb13d382f6 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:38:37.273805 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Start _get_guest_xml network_info=[{"id": "061a7108-6f47-4def-b12d-38eb13d382f6", "address": "fa:16:3e:48:bc:a4", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap061a7108-6f", "ovs_interfaceid": "061a7108-6f47-4def-b12d-38eb13d382f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'image_id': 'a9b18127-6fee-4ed6-b364-a2d634ecb8b7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:38:37.273805 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:38:37.273805 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='c1043abd-b0c0-439e-b065-8bef627483cb'), owner=OwnerMeta(userid='8a8a0b0240a34fb0bcf62ee7ec259cb2', username='tempest-AttachVolumeMultiAttachTest-1668992443-project-member', projectid='49c2798faed447838b6c87f6d15cce66', projectname='tempest-AttachVolumeMultiAttachTest-1668992443'), image=ImageMeta(id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "061a7108-6f47-4def-b12d-38eb13d382f6", "address": "fa:16:3e:48:bc:a4", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap061a7108-6f", "ovs_interfaceid": "061a7108-6f47-4def-b12d-38eb13d382f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470317.266564) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:38:37.273805 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:38:37.273805 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:38:37.273805 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:38:37.273805 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:38:37.273805 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:38:37.273805 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:38:37.273805 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:38:37.273805 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:38:37.273805 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:38:37.273805 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:38:37.273805 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:38:37.273805 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:38:37.273805 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:38:37.273805 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:38:37.273805 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:38:37.273805 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:38:37.288729 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:38:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='multiattach-server-0',id=14,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIANZiDTtI5cmApVvRJAaLuw+rm1nR4eCOZjHwVoNWhAR53DFExlyLfMWz+jjXnkCXdfpUcLxD2eMk9e+d1HV7SCzQccChfvPKV4jw2Mlc92UdPlKs2IxpAJWXP9L/ysw==',key_name='tempest-keypair-1990365436',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49c2798faed447838b6c87f6d15cce66',ramdisk_id='',reservation_id='r-dloghlmq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1668992443',owner_user_name='tempest-AttachVolumeMultiAttachTest-1668992443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:38:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a8a0b0240a34fb0bcf62ee7ec259cb2',uuid=c1043abd-b0c0-439e-b065-8bef627483cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "061a7108-6f47-4def-b12d-38eb13d382f6", "address": "fa:16:3e:48:bc:a4", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap061a7108-6f", "ovs_interfaceid": "061a7108-6f47-4def-b12d-38eb13d382f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:38:37.288729 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Converting VIF {"id": "061a7108-6f47-4def-b12d-38eb13d382f6", "address": "fa:16:3e:48:bc:a4", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap061a7108-6f", "ovs_interfaceid": "061a7108-6f47-4def-b12d-38eb13d382f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:38:37.288729 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:bc:a4,bridge_name='br-int',has_traffic_filtering=True,id=061a7108-6f47-4def-b12d-38eb13d382f6,network=Network(204eb6a3-9452-412e-ab0b-1594eb86bed2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap061a7108-6f') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:38:37.288729 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lazy-loading 'pci_devices' on Instance uuid c1043abd-b0c0-439e-b065-8bef627483cb {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:37.417428 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:37.582536 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0006570440000359667 future=) submitted to {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:37.583045 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Emitting event Stopped> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:38:37.583551 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:37.583551 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] VM Stopped (Lifecycle Event) Jun 26 10:38:37.584831 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=6.857296724999969 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:37.584831 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=6.857107043000042 future=) was cancelled while queued, skipping {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:37.584831 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:37.585266 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=10.978864309999835 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:37.585266 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=10.978721966999956 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:37.703219 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: 0b93909a-db10-4b65-b5a7-0aa3f0a47da7] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:37.765136 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-83c95d52-8720-4052-93ea-55df8763e0a2 req-2f9a3db4-1951-421f-8291-c425b0429942 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] End _get_guest_xml xml= Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: c1043abd-b0c0-439e-b065-8bef627483cb Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: instance-0000000e Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: 196608 Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: multiattach-server-0 Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: 2026-06-26 10:38:37 Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: 192 Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: 0 Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: 0 Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: True Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: bare Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: 0 Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: virtio Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: tempest-AttachVolumeMultiAttachTest-1668992443-project-member Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: tempest-AttachVolumeMultiAttachTest-1668992443 Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: c1043abd-b0c0-439e-b065-8bef627483cb Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: c1043abd-b0c0-439e-b065-8bef627483cb Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: hvm Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: 128 Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: Jun 26 10:38:37.789612 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:38:37.792438 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Preparing to wait for external event network-vif-plugged-061a7108-6f47-4def-b12d-38eb13d382f6 {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:38:37.792438 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "c1043abd-b0c0-439e-b065-8bef627483cb-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:37.792438 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "c1043abd-b0c0-439e-b065-8bef627483cb-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:37.792438 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "c1043abd-b0c0-439e-b065-8bef627483cb-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:37.794222 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:38:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='multiattach-server-0',id=14,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIANZiDTtI5cmApVvRJAaLuw+rm1nR4eCOZjHwVoNWhAR53DFExlyLfMWz+jjXnkCXdfpUcLxD2eMk9e+d1HV7SCzQccChfvPKV4jw2Mlc92UdPlKs2IxpAJWXP9L/ysw==',key_name='tempest-keypair-1990365436',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49c2798faed447838b6c87f6d15cce66',ramdisk_id='',reservation_id='r-dloghlmq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1668992443',owner_user_name='tempest-AttachVolumeMultiAttachTest-1668992443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:38:34Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a8a0b0240a34fb0bcf62ee7ec259cb2',uuid=c1043abd-b0c0-439e-b065-8bef627483cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "061a7108-6f47-4def-b12d-38eb13d382f6", "address": "fa:16:3e:48:bc:a4", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap061a7108-6f", "ovs_interfaceid": "061a7108-6f47-4def-b12d-38eb13d382f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:38:37.794432 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Converting VIF {"id": "061a7108-6f47-4def-b12d-38eb13d382f6", "address": "fa:16:3e:48:bc:a4", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap061a7108-6f", "ovs_interfaceid": "061a7108-6f47-4def-b12d-38eb13d382f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:38:37.794813 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:bc:a4,bridge_name='br-int',has_traffic_filtering=True,id=061a7108-6f47-4def-b12d-38eb13d382f6,network=Network(204eb6a3-9452-412e-ab0b-1594eb86bed2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap061a7108-6f') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:38:37.795019 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:bc:a4,bridge_name='br-int',has_traffic_filtering=True,id=061a7108-6f47-4def-b12d-38eb13d382f6,network=Network(204eb6a3-9452-412e-ab0b-1594eb86bed2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap061a7108-6f') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:38:37.795348 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:37.795551 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:37.795797 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:38:37.799786 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:37.799942 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'afe98f24-b8a8-5723-be0d-9ab4a4c13f14', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:37.803304 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:37.804095 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:37.806689 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:37.806852 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap061a7108-6f, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:37.807217 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap061a7108-6f, col_values=(('qos', UUID('ae44e6ef-1df1-4a30-8c09-433bd58cd46a')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:37.807389 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap061a7108-6f, col_values=(('external_ids', {'iface-id': '061a7108-6f47-4def-b12d-38eb13d382f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:bc:a4', 'vm-uuid': 'c1043abd-b0c0-439e-b065-8bef627483cb'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:37.817140 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:37.818562 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:37.823801 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:37.825062 np0000003731 nova-compute[98967]: INFO os_vif [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:bc:a4,bridge_name='br-int',has_traffic_filtering=True,id=061a7108-6f47-4def-b12d-38eb13d382f6,network=Network(204eb6a3-9452-412e-ab0b-1594eb86bed2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap061a7108-6f') Jun 26 10:38:38.086337 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-aeac6021-e492-461a-aa2a-fa1f577f5852 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: 64a636b4-e106-4968-8740-9938e9b2bcc8] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:38.113148 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "0ae0d213-f58c-4ee5-844f-960b16a5a95b" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:38.113148 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "0ae0d213-f58c-4ee5-844f-960b16a5a95b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:38.251523 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-83c95d52-8720-4052-93ea-55df8763e0a2 req-2f9a3db4-1951-421f-8291-c425b0429942 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:38.265030 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:38.499125 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-f94a6c83-9766-4c73-9959-3c0905ce2da3 req-990cd33a-0847-4c36-b6ac-22c138670e3e service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-deleted-f141a8bb-5a71-4872-b62f-9fce6052875a {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:38.499125 np0000003731 nova-compute[98967]: INFO nova.compute.manager [req-f94a6c83-9766-4c73-9959-3c0905ce2da3 req-990cd33a-0847-4c36-b6ac-22c138670e3e service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Neutron deleted interface f141a8bb-5a71-4872-b62f-9fce6052875a; detaching it from the instance and deleting it from the info cache Jun 26 10:38:38.506044 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-f94a6c83-9766-4c73-9959-3c0905ce2da3 req-990cd33a-0847-4c36-b6ac-22c138670e3e service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Detach interface failed, port_id=f141a8bb-5a71-4872-b62f-9fce6052875a, reason: Instance a686feac-bebe-47c8-a3c8-f3c2260ca7f5 could not be found. {{(pid=98967) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 26 10:38:38.554290 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-83c95d52-8720-4052-93ea-55df8763e0a2 req-2f9a3db4-1951-421f-8291-c425b0429942 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Updated VIF entry in instance network info cache for port 061a7108-6f47-4def-b12d-38eb13d382f6. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:38:38.554525 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-83c95d52-8720-4052-93ea-55df8763e0a2 req-2f9a3db4-1951-421f-8291-c425b0429942 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Updating instance_info_cache with network_info: [{"id": "061a7108-6f47-4def-b12d-38eb13d382f6", "address": "fa:16:3e:48:bc:a4", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap061a7108-6f", "ovs_interfaceid": "061a7108-6f47-4def-b12d-38eb13d382f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:38:38.612528 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Starting instance... {{(pid=98967) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 26 10:38:38.735723 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:38:38.735955 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:38:38.788845 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-d5112c6f-48b1-4671-a87c-9cf527b4605a req-5fca520c-7b42-4016-abe5-32a58fb250ac service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-deleted-38973918-1218-4531-8941-0e9fbff30e3e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:38.789070 np0000003731 nova-compute[98967]: INFO nova.compute.manager [req-d5112c6f-48b1-4671-a87c-9cf527b4605a req-5fca520c-7b42-4016-abe5-32a58fb250ac service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Neutron deleted interface 38973918-1218-4531-8941-0e9fbff30e3e; detaching it from the instance and deleting it from the info cache Jun 26 10:38:38.790422 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-d5112c6f-48b1-4671-a87c-9cf527b4605a req-5fca520c-7b42-4016-abe5-32a58fb250ac service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Detach interface failed, port_id=38973918-1218-4531-8941-0e9fbff30e3e, reason: Instance a686feac-bebe-47c8-a3c8-f3c2260ca7f5 could not be found. {{(pid=98967) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 26 10:38:39.056856 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-83c95d52-8720-4052-93ea-55df8763e0a2 req-2f9a3db4-1951-421f-8291-c425b0429942 service nova] Releasing lock "refresh_cache-c1043abd-b0c0-439e-b065-8bef627483cb" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:38:39.103239 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-68bf1b1a-1673-4297-b42a-ab2ba2ee4b92 req-4e445efc-1d10-4b3e-9d88-432cc85d6a84 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-deleted-fa54a649-79c1-4413-91b2-680216f8b045 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:39.103836 np0000003731 nova-compute[98967]: INFO nova.compute.manager [req-68bf1b1a-1673-4297-b42a-ab2ba2ee4b92 req-4e445efc-1d10-4b3e-9d88-432cc85d6a84 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Neutron deleted interface fa54a649-79c1-4413-91b2-680216f8b045; detaching it from the instance and deleting it from the info cache Jun 26 10:38:39.106697 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-68bf1b1a-1673-4297-b42a-ab2ba2ee4b92 req-4e445efc-1d10-4b3e-9d88-432cc85d6a84 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Detach interface failed, port_id=fa54a649-79c1-4413-91b2-680216f8b045, reason: Instance a686feac-bebe-47c8-a3c8-f3c2260ca7f5 could not be found. {{(pid=98967) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 26 10:38:39.184822 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:39.241914 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:38:39.358275 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:38:39.358412 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:38:39.358508 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No VIF found with MAC fa:16:3e:48:bc:a4, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:38:39.358931 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Using config drive Jun 26 10:38:39.556248 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [-] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:38:39.748566 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.769s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:39.750313 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.564s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:39.750569 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Start building networks asynchronously for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 26 10:38:39.756764 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98967) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 26 10:38:39.756764 np0000003731 nova-compute[98967]: INFO nova.compute.claims [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Claim successful on node np0000003731 Jun 26 10:38:39.840832 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "c8aff61a-5f59-4f8c-8288-abd5a7853474" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:39.841048 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:39.873283 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:40.001125 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Creating config drive at /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk.config Jun 26 10:38:40.004837 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkweg7wtf {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:40.046724 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpkweg7wtf" returned: 0 in 0.042s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:40.059044 np0000003731 nova-compute[98967]: INFO nova.compute.manager [-] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Took 5.52 seconds to deallocate network for instance. Jun 26 10:38:40.266258 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Allocating IP information in the background. {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 26 10:38:40.269698 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] allocate_for_instance() {{(pid=98967) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 26 10:38:40.269698 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:40.270852 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:40.343626 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Starting instance... {{(pid=98967) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 26 10:38:40.507672 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:40.536267 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:40.635671 np0000003731 nova-compute[98967]: DEBUG nova.policy [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': 'ad8d119c32e141afa9b00aa63bcc6770', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ed3cec81bee74bf3913ab4fcab11a000', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98967) authorize /opt/stack/nova/nova/policy.py:192}} Jun 26 10:38:40.641885 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:40.693108 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:40.693489 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:40.770478 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 26 10:38:40.902744 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-c9a29088-5447-456b-8d0c-f3a6fae811d2 req-b7c4d591-ac39-48ca-8687-33051dae8626 service nova] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Received event network-vif-deleted-4d0f4a94-bfe6-4fc2-b359-d4f5c90b3b9a {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:40.902744 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-c9a29088-5447-456b-8d0c-f3a6fae811d2 req-b7c4d591-ac39-48ca-8687-33051dae8626 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Received event network-vif-plugged-061a7108-6f47-4def-b12d-38eb13d382f6 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:40.902744 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c9a29088-5447-456b-8d0c-f3a6fae811d2 req-b7c4d591-ac39-48ca-8687-33051dae8626 service nova] Acquiring lock "c1043abd-b0c0-439e-b065-8bef627483cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:40.902744 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c9a29088-5447-456b-8d0c-f3a6fae811d2 req-b7c4d591-ac39-48ca-8687-33051dae8626 service nova] Lock "c1043abd-b0c0-439e-b065-8bef627483cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:40.902744 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c9a29088-5447-456b-8d0c-f3a6fae811d2 req-b7c4d591-ac39-48ca-8687-33051dae8626 service nova] Lock "c1043abd-b0c0-439e-b065-8bef627483cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:40.902744 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-c9a29088-5447-456b-8d0c-f3a6fae811d2 req-b7c4d591-ac39-48ca-8687-33051dae8626 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Processing event network-vif-plugged-061a7108-6f47-4def-b12d-38eb13d382f6 {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:38:40.938237 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:40.939869 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:41.413437 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Successfully created port: 49031ae0-122b-4f20-8d73-20048a6ad965 {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:38:41.471507 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:38:41.472092 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:38:41.568531 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:38:41.569578 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:38:41.569858 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] VM Started (Lifecycle Event) Jun 26 10:38:41.575111 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Guest created on hypervisor {{(pid=98967) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 26 10:38:41.581737 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Instance spawned successfully. Jun 26 10:38:41.581737 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 26 10:38:41.797906 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Took 1.74 seconds to detach 3 volumes for instance. Jun 26 10:38:41.975016 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:38:41.988392 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:42.008416 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Successfully created port: 9882d815-8273-4eb8-937b-a1c1e4af4018 {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:38:42.073311 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:42.075461 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:38:42.088901 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Found default for hw_cdrom_bus of ide {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:38:42.089106 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Found default for hw_disk_bus of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:38:42.089426 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Found default for hw_input_bus of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:38:42.089651 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Found default for hw_pointer_model of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:38:42.089947 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Found default for hw_video_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:38:42.092108 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Found default for hw_vif_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:38:42.285868 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Start building block device mappings for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 26 10:38:42.306790 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:42.420299 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:42.456468 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Successfully created port: 8d782392-1caa-4b0a-b7e2-58c03357a004 {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:38:42.487647 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.739s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:42.488462 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 1.552s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:42.488809 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Start building networks asynchronously for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 26 10:38:42.493739 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98967) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 26 10:38:42.493890 np0000003731 nova-compute[98967]: INFO nova.compute.claims [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Claim successful on node np0000003731 Jun 26 10:38:42.577624 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] During sync_power_state the instance has a pending task (spawning). Skip. Jun 26 10:38:42.577963 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Paused> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:38:42.578124 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] VM Paused (Lifecycle Event) Jun 26 10:38:42.597442 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Took 8.04 seconds to spawn the instance on the hypervisor. Jun 26 10:38:42.597613 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:42.791445 np0000003731 nova-compute[98967]: INFO nova.virt.block_device [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Booting with volume 0fe657ee-bc44-41d2-b197-f986995424e2 at /dev/vda Jun 26 10:38:42.822100 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:42.858393 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.79', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003731', 'execute': None}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:38:42.872116 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.scaleio [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98967) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 10:38:42.893271 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Running cmd (subprocess): nvme version {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:42.915833 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Successfully created port: 45a4f3f8-69ee-4cc0-811e-a1178c8b18f2 {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:38:42.923988 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] 'nvme version' failed. Not Retrying. {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 10:38:42.924230 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.nvmeof [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] nvme not present on system {{(pid=98967) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 10:38:42.933177 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98967) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 10:38:42.934492 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.lightos [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Current host hostNQN and IP(s) are ['10.4.3.79', 'fe80::f816:3eff:fe55:ba34', '192.168.40.6', 'fe80::f816:3eff:fe6b:fe1a', '192.168.50.6', 'fe80::f816:3eff:feca:9cd0', '192.168.10.6', 'fe80::f816:3eff:feb4:4e78', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f8bb:38ff:fe28:ff4a', 'fe80::fc16:3eff:fe37:b3f6', 'fe80::41a:feff:fe02:479d', 'fe80::fc16:3eff:fe5e:459', 'fe80::fc16:3eff:fe90:be9c', 'fe80::84cb:23ff:fe8e:e6e6', 'fe80::fc16:3eff:fe5a:811a', 'fe80::fc16:3eff:fe4c:ec5e', 'fe80::1cb1:31ff:fe57:6a2', 'fe80::fc16:3eff:fe1b:5509', 'fe80::fc16:3eff:fe48:bca4'] Jun 26 10:38:42.934595 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 10:38:42.934736 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] LIGHTOS: no hostnqn found. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 10:38:42.935017 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] <== get_connector_properties: return (76ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.79', 'host': 'np0000003731', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:2fddcc2116d6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '7f2a0776-2f14-4357-a22e-baa6677eb22e', 'nvme_native_multipath': False} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:38:42.935218 np0000003731 nova-compute[98967]: DEBUG nova.virt.block_device [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Updating existing volume attachment record: 39a212f3-1fb9-4c4a-89ba-4c8e8aabb2b6 {{(pid=98967) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 26 10:38:42.985258 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-bbf743a4-5916-41b2-850a-b7cff6d8fab1 req-e3c75971-3abe-4180-b41c-20e0a701cad0 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Received event network-vif-plugged-061a7108-6f47-4def-b12d-38eb13d382f6 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:42.985258 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-bbf743a4-5916-41b2-850a-b7cff6d8fab1 req-e3c75971-3abe-4180-b41c-20e0a701cad0 service nova] Acquiring lock "c1043abd-b0c0-439e-b065-8bef627483cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:42.985258 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-bbf743a4-5916-41b2-850a-b7cff6d8fab1 req-e3c75971-3abe-4180-b41c-20e0a701cad0 service nova] Lock "c1043abd-b0c0-439e-b065-8bef627483cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:42.986859 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-bbf743a4-5916-41b2-850a-b7cff6d8fab1 req-e3c75971-3abe-4180-b41c-20e0a701cad0 service nova] Lock "c1043abd-b0c0-439e-b065-8bef627483cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.003s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:42.987849 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-bbf743a4-5916-41b2-850a-b7cff6d8fab1 req-e3c75971-3abe-4180-b41c-20e0a701cad0 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] No waiting events found dispatching network-vif-plugged-061a7108-6f47-4def-b12d-38eb13d382f6 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:42.991191 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-bbf743a4-5916-41b2-850a-b7cff6d8fab1 req-e3c75971-3abe-4180-b41c-20e0a701cad0 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Received unexpected event network-vif-plugged-061a7108-6f47-4def-b12d-38eb13d382f6 for instance with vm_state active and task_state None. Jun 26 10:38:43.003288 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Allocating IP information in the background. {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 26 10:38:43.008960 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] allocate_for_instance() {{(pid=98967) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 26 10:38:43.009747 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:43.010083 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:43.080810 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:43.083549 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:38:43.083653 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] VM Resumed (Lifecycle Event) Jun 26 10:38:43.092059 np0000003731 nova-compute[98967]: DEBUG nova.policy [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72704c563abb412aa2c238092bd55ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea834a26efe148649425d3e02d974ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98967) authorize /opt/stack/nova/nova/policy.py:192}} Jun 26 10:38:43.108866 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Took 13.72 seconds to build instance. Jun 26 10:38:43.369347 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Successfully created port: c2ff0bc1-8b84-4517-b347-f78bb6a9e14c {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:38:43.511663 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 26 10:38:43.587740 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:43.590861 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Successfully created port: 91b09012-11f2-4c26-a3c5-80cff99fe65e {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:38:43.593750 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:38:43.611651 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-31dd26f4-1b41-4792-b632-f42cf584cfd5 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "c1043abd-b0c0-439e-b065-8bef627483cb" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.236s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:43.675941 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:44.022825 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Start building block device mappings for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 26 10:38:44.082952 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Successfully updated port: 49031ae0-122b-4f20-8d73-20048a6ad965 {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:38:44.161349 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-fecb7ebb-41db-4e41-ac16-7d90c8d6ae18 req-9d2e2013-1555-4c0a-9b42-d90ac1a9d6b4 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-changed-49031ae0-122b-4f20-8d73-20048a6ad965 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:44.162223 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-fecb7ebb-41db-4e41-ac16-7d90c8d6ae18 req-9d2e2013-1555-4c0a-9b42-d90ac1a9d6b4 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Refreshing instance network info cache due to event network-changed-49031ae0-122b-4f20-8d73-20048a6ad965. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:38:44.162503 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-fecb7ebb-41db-4e41-ac16-7d90c8d6ae18 req-9d2e2013-1555-4c0a-9b42-d90ac1a9d6b4 service nova] Acquiring lock "refresh_cache-ee4d14ad-8bd2-4b8b-9526-51abafe757f2" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:38:44.162503 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-fecb7ebb-41db-4e41-ac16-7d90c8d6ae18 req-9d2e2013-1555-4c0a-9b42-d90ac1a9d6b4 service nova] Acquired lock "refresh_cache-ee4d14ad-8bd2-4b8b-9526-51abafe757f2" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:38:44.162726 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-fecb7ebb-41db-4e41-ac16-7d90c8d6ae18 req-9d2e2013-1555-4c0a-9b42-d90ac1a9d6b4 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Refreshing network info cache for port 49031ae0-122b-4f20-8d73-20048a6ad965 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:38:44.229942 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Successfully updated port: 91b09012-11f2-4c26-a3c5-80cff99fe65e {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:38:44.268303 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:38:44.268592 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:38:44.578951 np0000003731 nova-compute[98967]: INFO nova.virt.block_device [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Booting with volume 3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 at /dev/vdb Jun 26 10:38:44.625963 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.79', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003731', 'execute': None}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:38:44.644091 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.scaleio [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98967) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 10:38:44.667333 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-fecb7ebb-41db-4e41-ac16-7d90c8d6ae18 req-9d2e2013-1555-4c0a-9b42-d90ac1a9d6b4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:44.670582 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Running cmd (subprocess): nvme version {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:44.703043 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] 'nvme version' failed. Not Retrying. {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 10:38:44.703402 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.nvmeof [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] nvme not present on system {{(pid=98967) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 10:38:44.714847 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98967) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 10:38:44.716737 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.lightos [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Current host hostNQN and IP(s) are ['10.4.3.79', 'fe80::f816:3eff:fe55:ba34', '192.168.40.6', 'fe80::f816:3eff:fe6b:fe1a', '192.168.50.6', 'fe80::f816:3eff:feca:9cd0', '192.168.10.6', 'fe80::f816:3eff:feb4:4e78', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f8bb:38ff:fe28:ff4a', 'fe80::fc16:3eff:fe37:b3f6', 'fe80::41a:feff:fe02:479d', 'fe80::fc16:3eff:fe5e:459', 'fe80::fc16:3eff:fe90:be9c', 'fe80::84cb:23ff:fe8e:e6e6', 'fe80::fc16:3eff:fe5a:811a', 'fe80::fc16:3eff:fe4c:ec5e', 'fe80::1cb1:31ff:fe57:6a2', 'fe80::fc16:3eff:fe1b:5509', 'fe80::fc16:3eff:fe48:bca4'] Jun 26 10:38:44.716944 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 10:38:44.717121 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] LIGHTOS: no hostnqn found. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 10:38:44.717585 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] <== get_connector_properties: return (91ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.79', 'host': 'np0000003731', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:2fddcc2116d6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '7f2a0776-2f14-4357-a22e-baa6677eb22e', 'nvme_native_multipath': False} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:38:44.717811 np0000003731 nova-compute[98967]: DEBUG nova.virt.block_device [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Updating existing volume attachment record: 4de0bd43-66f3-408b-969c-e0f758691e42 {{(pid=98967) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 26 10:38:44.732381 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "refresh_cache-0ae0d213-f58c-4ee5-844f-960b16a5a95b" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:38:44.732504 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquired lock "refresh_cache-0ae0d213-f58c-4ee5-844f-960b16a5a95b" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:38:44.732700 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:38:44.773483 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:38:44.794144 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-fecb7ebb-41db-4e41-ac16-7d90c8d6ae18 req-9d2e2013-1555-4c0a-9b42-d90ac1a9d6b4 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:38:44.856058 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-95af2fbd-25a1-48bd-aebb-d0efeb183e85 req-e0732095-f46d-4b34-9c41-8eb5ff84eb9a service nova] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Received event network-changed-32e8fd61-b6bb-41bf-80b8-c09e23741e03 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:44.856667 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-95af2fbd-25a1-48bd-aebb-d0efeb183e85 req-e0732095-f46d-4b34-9c41-8eb5ff84eb9a service nova] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Refreshing instance network info cache due to event network-changed-32e8fd61-b6bb-41bf-80b8-c09e23741e03. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:38:44.856873 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-95af2fbd-25a1-48bd-aebb-d0efeb183e85 req-e0732095-f46d-4b34-9c41-8eb5ff84eb9a service nova] Acquiring lock "refresh_cache-212147b0-26de-42cd-b43d-057ec8d61c72" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:38:44.857021 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-95af2fbd-25a1-48bd-aebb-d0efeb183e85 req-e0732095-f46d-4b34-9c41-8eb5ff84eb9a service nova] Acquired lock "refresh_cache-212147b0-26de-42cd-b43d-057ec8d61c72" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:38:44.857184 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-95af2fbd-25a1-48bd-aebb-d0efeb183e85 req-e0732095-f46d-4b34-9c41-8eb5ff84eb9a service nova] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Refreshing network info cache for port 32e8fd61-b6bb-41bf-80b8-c09e23741e03 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:38:45.006663 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-fecb7ebb-41db-4e41-ac16-7d90c8d6ae18 req-9d2e2013-1555-4c0a-9b42-d90ac1a9d6b4 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:38:45.035463 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Start spawning the instance on the hypervisor. {{(pid=98967) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 26 10:38:45.036761 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Creating instance directory {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 26 10:38:45.036923 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Creating image(s) Jun 26 10:38:45.038172 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "/opt/stack/data/nova/instances/0ae0d213-f58c-4ee5-844f-960b16a5a95b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:45.038519 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "/opt/stack/data/nova/instances/0ae0d213-f58c-4ee5-844f-960b16a5a95b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:45.039395 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "/opt/stack/data/nova/instances/0ae0d213-f58c-4ee5-844f-960b16a5a95b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:45.040103 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:45.044176 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:45.044922 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:45.073568 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-ea3932b5-2a7d-4144-a037-51c9cd1189f2 req-0e1c5fb4-1e4a-432c-80b5-00d54f0622ef service nova] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Received event network-changed-91b09012-11f2-4c26-a3c5-80cff99fe65e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:45.073934 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-ea3932b5-2a7d-4144-a037-51c9cd1189f2 req-0e1c5fb4-1e4a-432c-80b5-00d54f0622ef service nova] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Refreshing instance network info cache due to event network-changed-91b09012-11f2-4c26-a3c5-80cff99fe65e. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:38:45.074247 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-ea3932b5-2a7d-4144-a037-51c9cd1189f2 req-0e1c5fb4-1e4a-432c-80b5-00d54f0622ef service nova] Acquiring lock "refresh_cache-0ae0d213-f58c-4ee5-844f-960b16a5a95b" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:38:45.122621 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.078s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:45.122993 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:45.123399 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:45.123821 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:45.130231 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:45.130231 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:45.212775 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Successfully updated port: ebb9bc95-98ee-43f1-bd95-8a3da5497c72 {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:38:45.214597 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.086s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:45.218030 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/0ae0d213-f58c-4ee5-844f-960b16a5a95b/disk 1073741824 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:45.258282 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/0ae0d213-f58c-4ee5-844f-960b16a5a95b/disk 1073741824" returned: 0 in 0.043s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:45.258658 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.135s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:45.258957 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:45.288071 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.799s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:45.289549 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Start building networks asynchronously for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 26 10:38:45.295278 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 2.988s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:45.343547 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:38:45.360289 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-95af2fbd-25a1-48bd-aebb-d0efeb183e85 req-e0732095-f46d-4b34-9c41-8eb5ff84eb9a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:45.362922 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.104s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:45.363576 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Checking if we can resize image /opt/stack/data/nova/instances/0ae0d213-f58c-4ee5-844f-960b16a5a95b/disk. size=1073741824 {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 26 10:38:45.364183 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ae0d213-f58c-4ee5-844f-960b16a5a95b/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:45.467332 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ae0d213-f58c-4ee5-844f-960b16a5a95b/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:45.467699 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Cannot resize image /opt/stack/data/nova/instances/0ae0d213-f58c-4ee5-844f-960b16a5a95b/disk to a smaller size. {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 26 10:38:45.468101 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Created local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 26 10:38:45.468280 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Ensure instance console log exists: /opt/stack/data/nova/instances/0ae0d213-f58c-4ee5-844f-960b16a5a95b/console.log {{(pid=98967) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 26 10:38:45.468618 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:45.468783 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:45.468927 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:45.509541 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-fecb7ebb-41db-4e41-ac16-7d90c8d6ae18 req-9d2e2013-1555-4c0a-9b42-d90ac1a9d6b4 service nova] Releasing lock "refresh_cache-ee4d14ad-8bd2-4b8b-9526-51abafe757f2" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:38:45.625109 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:45.663889 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:45.810248 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Allocating IP information in the background. {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 26 10:38:45.810445 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] allocate_for_instance() {{(pid=98967) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 26 10:38:45.811352 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:45.811611 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:45.885349 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Updating instance_info_cache with network_info: [{"id": "91b09012-11f2-4c26-a3c5-80cff99fe65e", "address": "fa:16:3e:f2:78:1c", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91b09012-11", "ovs_interfaceid": "91b09012-11f2-4c26-a3c5-80cff99fe65e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:38:45.940934 np0000003731 nova-compute[98967]: DEBUG nova.policy [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '04176251e13046eb8cfc1908246d4d9d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '58a58b94e5ec406182da9117e14aa789', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98967) authorize /opt/stack/nova/nova/policy.py:192}} Jun 26 10:38:46.073142 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-95af2fbd-25a1-48bd-aebb-d0efeb183e85 req-e0732095-f46d-4b34-9c41-8eb5ff84eb9a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:46.155218 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:38:46.155869 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:38:46.245279 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-71805539-2770-470b-b04b-55e3ee19df1a req-5034f910-dadb-4da4-b621-2b532687c17d service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-changed-ebb9bc95-98ee-43f1-bd95-8a3da5497c72 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:46.245434 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-71805539-2770-470b-b04b-55e3ee19df1a req-5034f910-dadb-4da4-b621-2b532687c17d service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Refreshing instance network info cache due to event network-changed-ebb9bc95-98ee-43f1-bd95-8a3da5497c72. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:38:46.245571 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-71805539-2770-470b-b04b-55e3ee19df1a req-5034f910-dadb-4da4-b621-2b532687c17d service nova] Acquiring lock "refresh_cache-ee4d14ad-8bd2-4b8b-9526-51abafe757f2" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:38:46.245684 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-71805539-2770-470b-b04b-55e3ee19df1a req-5034f910-dadb-4da4-b621-2b532687c17d service nova] Acquired lock "refresh_cache-ee4d14ad-8bd2-4b8b-9526-51abafe757f2" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:38:46.245809 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-71805539-2770-470b-b04b-55e3ee19df1a req-5034f910-dadb-4da4-b621-2b532687c17d service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Refreshing network info cache for port ebb9bc95-98ee-43f1-bd95-8a3da5497c72 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:38:46.268353 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-95af2fbd-25a1-48bd-aebb-d0efeb183e85 req-e0732095-f46d-4b34-9c41-8eb5ff84eb9a service nova] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Updated VIF entry in instance network info cache for port 32e8fd61-b6bb-41bf-80b8-c09e23741e03. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:38:46.268608 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-95af2fbd-25a1-48bd-aebb-d0efeb183e85 req-e0732095-f46d-4b34-9c41-8eb5ff84eb9a service nova] [instance: 212147b0-26de-42cd-b43d-057ec8d61c72] Updating instance_info_cache with network_info: [{"id": "32e8fd61-b6bb-41bf-80b8-c09e23741e03", "address": "fa:16:3e:90:be:9c", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.7", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap32e8fd61-b6", "ovs_interfaceid": "32e8fd61-b6bb-41bf-80b8-c09e23741e03", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:38:46.317087 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 26 10:38:46.380636 np0000003731 nova-compute[98967]: INFO nova.virt.block_device [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Booting with volume eab5497d-64ad-45f7-af05-50cde809958d at /dev/vdc Jun 26 10:38:46.388890 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Releasing lock "refresh_cache-0ae0d213-f58c-4ee5-844f-960b16a5a95b" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:38:46.389466 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Instance network_info: |[{"id": "91b09012-11f2-4c26-a3c5-80cff99fe65e", "address": "fa:16:3e:f2:78:1c", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91b09012-11", "ovs_interfaceid": "91b09012-11f2-4c26-a3c5-80cff99fe65e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 26 10:38:46.391140 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Start _get_guest_xml network_info=[{"id": "91b09012-11f2-4c26-a3c5-80cff99fe65e", "address": "fa:16:3e:f2:78:1c", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91b09012-11", "ovs_interfaceid": "91b09012-11f2-4c26-a3c5-80cff99fe65e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'image_id': 'a9b18127-6fee-4ed6-b364-a2d634ecb8b7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:38:46.394274 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-ea3932b5-2a7d-4144-a037-51c9cd1189f2 req-0e1c5fb4-1e4a-432c-80b5-00d54f0622ef service nova] Acquired lock "refresh_cache-0ae0d213-f58c-4ee5-844f-960b16a5a95b" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:38:46.394642 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-ea3932b5-2a7d-4144-a037-51c9cd1189f2 req-0e1c5fb4-1e4a-432c-80b5-00d54f0622ef service nova] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Refreshing network info cache for port 91b09012-11f2-4c26-a3c5-80cff99fe65e {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:38:46.398687 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:38:46.400276 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1632021326', uuid='0ae0d213-f58c-4ee5-844f-960b16a5a95b'), owner=OwnerMeta(userid='72704c563abb412aa2c238092bd55ec4', username='tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member', projectid='ea834a26efe148649425d3e02d974ef4', projectname='tempest-ServerBootFromVolumeStableRescueTest-618712607'), image=ImageMeta(id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "91b09012-11f2-4c26-a3c5-80cff99fe65e", "address": "fa:16:3e:f2:78:1c", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91b09012-11", "ovs_interfaceid": "91b09012-11f2-4c26-a3c5-80cff99fe65e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470326.399811) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:38:46.402080 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:38:46.403611 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:38:46.405897 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:38:46.406193 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:38:46.408316 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:38:46.409375 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:38:46.409655 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:38:46.409765 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:38:46.409945 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:38:46.410095 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:38:46.410227 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:38:46.410443 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:38:46.410601 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:38:46.410766 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:38:46.410914 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:38:46.411088 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:38:46.430946 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:38:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1632021326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-serverbootfromvolumestablerescuetest-server-1632021326',id=16,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea834a26efe148649425d3e02d974ef4',ramdisk_id='',reservation_id='r-1f30onde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-618712607',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:38:44Z,user_data=None,user_id='72704c563abb412aa2c238092bd55ec4',uuid=0ae0d213-f58c-4ee5-844f-960b16a5a95b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91b09012-11f2-4c26-a3c5-80cff99fe65e", "address": "fa:16:3e:f2:78:1c", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91b09012-11", "ovs_interfaceid": "91b09012-11f2-4c26-a3c5-80cff99fe65e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:38:46.431235 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Converting VIF {"id": "91b09012-11f2-4c26-a3c5-80cff99fe65e", "address": "fa:16:3e:f2:78:1c", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91b09012-11", "ovs_interfaceid": "91b09012-11f2-4c26-a3c5-80cff99fe65e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:38:46.431943 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:78:1c,bridge_name='br-int',has_traffic_filtering=True,id=91b09012-11f2-4c26-a3c5-80cff99fe65e,network=Network(67c50821-8012-4a48-8c3a-b0cc3d2ddcb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91b09012-11') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:38:46.432889 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lazy-loading 'pci_devices' on Instance uuid 0ae0d213-f58c-4ee5-844f-960b16a5a95b {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:46.447048 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.79', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003731', 'execute': None}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:38:46.462156 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.scaleio [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98967) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 10:38:46.484467 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:46.484631 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:46.496985 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Running cmd (subprocess): nvme version {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:46.533424 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] 'nvme version' failed. Not Retrying. {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 10:38:46.534275 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.nvmeof [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] nvme not present on system {{(pid=98967) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 10:38:46.547371 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98967) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 10:38:46.548592 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.lightos [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Current host hostNQN and IP(s) are ['10.4.3.79', 'fe80::f816:3eff:fe55:ba34', '192.168.40.6', 'fe80::f816:3eff:fe6b:fe1a', '192.168.50.6', 'fe80::f816:3eff:feca:9cd0', '192.168.10.6', 'fe80::f816:3eff:feb4:4e78', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f8bb:38ff:fe28:ff4a', 'fe80::fc16:3eff:fe37:b3f6', 'fe80::41a:feff:fe02:479d', 'fe80::fc16:3eff:fe5e:459', 'fe80::fc16:3eff:fe90:be9c', 'fe80::84cb:23ff:fe8e:e6e6', 'fe80::fc16:3eff:fe5a:811a', 'fe80::fc16:3eff:fe4c:ec5e', 'fe80::1cb1:31ff:fe57:6a2', 'fe80::fc16:3eff:fe1b:5509', 'fe80::fc16:3eff:fe48:bca4'] Jun 26 10:38:46.549134 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 10:38:46.549134 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] LIGHTOS: no hostnqn found. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 10:38:46.549134 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.79', 'host': 'np0000003731', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:2fddcc2116d6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '7f2a0776-2f14-4357-a22e-baa6677eb22e', 'nvme_native_multipath': False} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:38:46.549508 np0000003731 nova-compute[98967]: DEBUG nova.virt.block_device [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Updating existing volume attachment record: 24e6a31f-a274-4d00-9ed1-72391acb528f {{(pid=98967) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 26 10:38:46.563337 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Successfully updated port: dcce8bc4-9171-4ef4-b762-37d89aea863b {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:38:46.621164 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Successfully created port: 93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:38:46.662719 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:38:46.751091 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-71805539-2770-470b-b04b-55e3ee19df1a req-5034f910-dadb-4da4-b621-2b532687c17d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:46.770693 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-95af2fbd-25a1-48bd-aebb-d0efeb183e85 req-e0732095-f46d-4b34-9c41-8eb5ff84eb9a service nova] Releasing lock "refresh_cache-212147b0-26de-42cd-b43d-057ec8d61c72" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:38:46.820850 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Start building block device mappings for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 26 10:38:46.897829 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-ea3932b5-2a7d-4144-a037-51c9cd1189f2 req-0e1c5fb4-1e4a-432c-80b5-00d54f0622ef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:46.933173 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-3006b083-fd66-462c-8a17-1d90d333de03 req-b1206deb-9f89-4e3e-8e90-adeb736bdae3 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Received event network-changed-061a7108-6f47-4def-b12d-38eb13d382f6 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:46.933173 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-3006b083-fd66-462c-8a17-1d90d333de03 req-b1206deb-9f89-4e3e-8e90-adeb736bdae3 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Refreshing instance network info cache due to event network-changed-061a7108-6f47-4def-b12d-38eb13d382f6. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:38:46.933173 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-3006b083-fd66-462c-8a17-1d90d333de03 req-b1206deb-9f89-4e3e-8e90-adeb736bdae3 service nova] Acquiring lock "refresh_cache-c1043abd-b0c0-439e-b065-8bef627483cb" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:38:46.933173 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-3006b083-fd66-462c-8a17-1d90d333de03 req-b1206deb-9f89-4e3e-8e90-adeb736bdae3 service nova] Acquired lock "refresh_cache-c1043abd-b0c0-439e-b065-8bef627483cb" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:38:46.933173 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-3006b083-fd66-462c-8a17-1d90d333de03 req-b1206deb-9f89-4e3e-8e90-adeb736bdae3 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Refreshing network info cache for port 061a7108-6f47-4def-b12d-38eb13d382f6 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] End _get_guest_xml xml= Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: 0ae0d213-f58c-4ee5-844f-960b16a5a95b Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: instance-00000010 Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: 196608 Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: tempest-ServerBootFromVolumeStableRescueTest-server-1632021326 Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: 2026-06-26 10:38:46 Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: 192 Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: 0 Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: 0 Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: True Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: bare Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: 0 Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: virtio Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: tempest-ServerBootFromVolumeStableRescueTest-618712607 Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: 0ae0d213-f58c-4ee5-844f-960b16a5a95b Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: 0ae0d213-f58c-4ee5-844f-960b16a5a95b Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: hvm Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: 128 Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: Jun 26 10:38:46.938262 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:38:46.944175 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Preparing to wait for external event network-vif-plugged-91b09012-11f2-4c26-a3c5-80cff99fe65e {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:38:46.944175 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "0ae0d213-f58c-4ee5-844f-960b16a5a95b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:46.944175 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "0ae0d213-f58c-4ee5-844f-960b16a5a95b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:46.944175 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "0ae0d213-f58c-4ee5-844f-960b16a5a95b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:46.944175 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:38:36Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1632021326',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-serverbootfromvolumestablerescuetest-server-1632021326',id=16,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea834a26efe148649425d3e02d974ef4',ramdisk_id='',reservation_id='r-1f30onde',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-618712607',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:38:44Z,user_data=None,user_id='72704c563abb412aa2c238092bd55ec4',uuid=0ae0d213-f58c-4ee5-844f-960b16a5a95b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "91b09012-11f2-4c26-a3c5-80cff99fe65e", "address": "fa:16:3e:f2:78:1c", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91b09012-11", "ovs_interfaceid": "91b09012-11f2-4c26-a3c5-80cff99fe65e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:38:46.944175 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Converting VIF {"id": "91b09012-11f2-4c26-a3c5-80cff99fe65e", "address": "fa:16:3e:f2:78:1c", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91b09012-11", "ovs_interfaceid": "91b09012-11f2-4c26-a3c5-80cff99fe65e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:38:46.945475 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:f2:78:1c,bridge_name='br-int',has_traffic_filtering=True,id=91b09012-11f2-4c26-a3c5-80cff99fe65e,network=Network(67c50821-8012-4a48-8c3a-b0cc3d2ddcb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91b09012-11') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:38:46.945475 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:78:1c,bridge_name='br-int',has_traffic_filtering=True,id=91b09012-11f2-4c26-a3c5-80cff99fe65e,network=Network(67c50821-8012-4a48-8c3a-b0cc3d2ddcb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91b09012-11') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:38:46.946270 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:46.946565 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:46.946999 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:38:46.951199 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-71805539-2770-470b-b04b-55e3ee19df1a req-5034f910-dadb-4da4-b621-2b532687c17d service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:38:46.954709 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:46.956772 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'db9ba386-4ead-5b83-b858-8f8bd4baaa8b', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:46.958512 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:46.968963 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:46.969327 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap91b09012-11, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:46.969640 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap91b09012-11, col_values=(('qos', UUID('9aa41f43-0bea-4f91-aab0-045ebe06f2d1')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:46.969797 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap91b09012-11, col_values=(('external_ids', {'iface-id': '91b09012-11f2-4c26-a3c5-80cff99fe65e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:f2:78:1c', 'vm-uuid': '0ae0d213-f58c-4ee5-844f-960b16a5a95b'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:46.973566 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:46.977073 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:46.983831 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:46.983831 np0000003731 nova-compute[98967]: INFO os_vif [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:f2:78:1c,bridge_name='br-int',has_traffic_filtering=True,id=91b09012-11f2-4c26-a3c5-80cff99fe65e,network=Network(67c50821-8012-4a48-8c3a-b0cc3d2ddcb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap91b09012-11') Jun 26 10:38:46.986980 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Starting instance... {{(pid=98967) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 26 10:38:47.172115 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 1.878s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:47.255573 np0000003731 nova-compute[98967]: INFO nova.scheduler.client.report [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Deleted allocations for instance a686feac-bebe-47c8-a3c8-f3c2260ca7f5 Jun 26 10:38:47.293860 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Successfully updated port: 93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:38:47.337266 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-9af07916-b028-4c08-905a-3651d393d7a8 req-46d2ec6d-8496-4b98-8185-dbc428eaf952 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Received event network-changed-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:47.337266 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-9af07916-b028-4c08-905a-3651d393d7a8 req-46d2ec6d-8496-4b98-8185-dbc428eaf952 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Refreshing instance network info cache due to event network-changed-93123956-587e-4fec-b4de-833327660f6e. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:38:47.337461 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-9af07916-b028-4c08-905a-3651d393d7a8 req-46d2ec6d-8496-4b98-8185-dbc428eaf952 service nova] Acquiring lock "refresh_cache-c8aff61a-5f59-4f8c-8288-abd5a7853474" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:38:47.338115 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-9af07916-b028-4c08-905a-3651d393d7a8 req-46d2ec6d-8496-4b98-8185-dbc428eaf952 service nova] Acquired lock "refresh_cache-c8aff61a-5f59-4f8c-8288-abd5a7853474" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:38:47.338277 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-9af07916-b028-4c08-905a-3651d393d7a8 req-46d2ec6d-8496-4b98-8185-dbc428eaf952 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Refreshing network info cache for port 93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:38:47.360489 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-71805539-2770-470b-b04b-55e3ee19df1a req-5034f910-dadb-4da4-b621-2b532687c17d service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:38:47.421867 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:47.436165 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-3006b083-fd66-462c-8a17-1d90d333de03 req-b1206deb-9f89-4e3e-8e90-adeb736bdae3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:47.573647 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:47.573908 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:47.579612 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98967) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 26 10:38:47.579849 np0000003731 nova-compute[98967]: INFO nova.compute.claims [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Claim successful on node np0000003731 Jun 26 10:38:47.611019 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-ea3932b5-2a7d-4144-a037-51c9cd1189f2 req-0e1c5fb4-1e4a-432c-80b5-00d54f0622ef service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:47.788139 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Successfully updated port: 9882d815-8273-4eb8-937b-a1c1e4af4018 {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:38:47.795421 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "refresh_cache-c8aff61a-5f59-4f8c-8288-abd5a7853474" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:38:47.808625 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-ea3932b5-2a7d-4144-a037-51c9cd1189f2 req-0e1c5fb4-1e4a-432c-80b5-00d54f0622ef service nova] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Updated VIF entry in instance network info cache for port 91b09012-11f2-4c26-a3c5-80cff99fe65e. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:38:47.809430 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-ea3932b5-2a7d-4144-a037-51c9cd1189f2 req-0e1c5fb4-1e4a-432c-80b5-00d54f0622ef service nova] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Updating instance_info_cache with network_info: [{"id": "91b09012-11f2-4c26-a3c5-80cff99fe65e", "address": "fa:16:3e:f2:78:1c", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.6", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap91b09012-11", "ovs_interfaceid": "91b09012-11f2-4c26-a3c5-80cff99fe65e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:38:47.839142 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Start spawning the instance on the hypervisor. {{(pid=98967) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 26 10:38:47.840626 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-9af07916-b028-4c08-905a-3651d393d7a8 req-46d2ec6d-8496-4b98-8185-dbc428eaf952 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:47.846434 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Creating instance directory {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 26 10:38:47.846963 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Creating image(s) Jun 26 10:38:47.847853 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "/opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:47.848097 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "/opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:47.848601 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "/opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:47.849139 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:47.857336 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:47.858432 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:47.876425 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-71805539-2770-470b-b04b-55e3ee19df1a req-5034f910-dadb-4da4-b621-2b532687c17d service nova] Releasing lock "refresh_cache-ee4d14ad-8bd2-4b8b-9526-51abafe757f2" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:38:47.933818 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.075s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:47.934723 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:47.938027 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:47.938027 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:47.940868 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:47.943200 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-9af07916-b028-4c08-905a-3651d393d7a8 req-46d2ec6d-8496-4b98-8185-dbc428eaf952 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:38:47.948034 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:48.020550 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-3006b083-fd66-462c-8a17-1d90d333de03 req-b1206deb-9f89-4e3e-8e90-adeb736bdae3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:48.024074 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.079s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:48.024439 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474/disk 1073741824 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:48.070967 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474/disk 1073741824" returned: 0 in 0.046s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:48.071385 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.136s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:48.071719 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:48.166810 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.095s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:48.169024 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474/disk. size=1073741824 {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 26 10:38:48.169024 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:48.236606 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-9af07916-b028-4c08-905a-3651d393d7a8 req-46d2ec6d-8496-4b98-8185-dbc428eaf952 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:38:48.266160 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:48.266544 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Cannot resize image /opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474/disk to a smaller size. {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 26 10:38:48.266894 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Created local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 26 10:38:48.267136 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Ensure instance console log exists: /opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474/console.log {{(pid=98967) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 26 10:38:48.267775 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:48.268062 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:48.268240 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:48.268776 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c8197531-a8e7-47ba-9ffc-0896a99f3763 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Lock "a686feac-bebe-47c8-a3c8-f3c2260ca7f5" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 17.383s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:48.307288 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-3006b083-fd66-462c-8a17-1d90d333de03 req-b1206deb-9f89-4e3e-8e90-adeb736bdae3 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Updated VIF entry in instance network info cache for port 061a7108-6f47-4def-b12d-38eb13d382f6. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:38:48.307761 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-3006b083-fd66-462c-8a17-1d90d333de03 req-b1206deb-9f89-4e3e-8e90-adeb736bdae3 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Updating instance_info_cache with network_info: [{"id": "061a7108-6f47-4def-b12d-38eb13d382f6", "address": "fa:16:3e:48:bc:a4", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap061a7108-6f", "ovs_interfaceid": "061a7108-6f47-4def-b12d-38eb13d382f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:38:48.314813 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-ea3932b5-2a7d-4144-a037-51c9cd1189f2 req-0e1c5fb4-1e4a-432c-80b5-00d54f0622ef service nova] Releasing lock "refresh_cache-0ae0d213-f58c-4ee5-844f-960b16a5a95b" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:38:48.338398 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-267d5697-df05-4d7b-9d88-5fa93836da0b req-a58b59f4-dfc6-4740-8989-a1f62ba1d604 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-changed-9882d815-8273-4eb8-937b-a1c1e4af4018 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:48.339407 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-267d5697-df05-4d7b-9d88-5fa93836da0b req-a58b59f4-dfc6-4740-8989-a1f62ba1d604 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Refreshing instance network info cache due to event network-changed-9882d815-8273-4eb8-937b-a1c1e4af4018. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:38:48.339407 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-267d5697-df05-4d7b-9d88-5fa93836da0b req-a58b59f4-dfc6-4740-8989-a1f62ba1d604 service nova] Acquiring lock "refresh_cache-ee4d14ad-8bd2-4b8b-9526-51abafe757f2" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:38:48.339407 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-267d5697-df05-4d7b-9d88-5fa93836da0b req-a58b59f4-dfc6-4740-8989-a1f62ba1d604 service nova] Acquired lock "refresh_cache-ee4d14ad-8bd2-4b8b-9526-51abafe757f2" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:38:48.339407 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-267d5697-df05-4d7b-9d88-5fa93836da0b req-a58b59f4-dfc6-4740-8989-a1f62ba1d604 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Refreshing network info cache for port 9882d815-8273-4eb8-937b-a1c1e4af4018 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:38:48.513539 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:38:48.513765 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:38:48.513942 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] No VIF found with MAC fa:16:3e:f2:78:1c, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:38:48.514661 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Using config drive Jun 26 10:38:48.564442 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005050560000654514 future=) submitted to {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:48.564585 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:38:48.565211 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] Emitting event Stopped> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:38:48.565792 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] VM Stopped (Lifecycle Event) Jun 26 10:38:48.705897 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Start spawning the instance on the hypervisor. {{(pid=98967) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 26 10:38:48.712592 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Creating instance directory {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 26 10:38:48.712917 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Creating image(s) Jun 26 10:38:48.713451 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Did not create local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 26 10:38:48.713595 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Ensure instance console log exists: /opt/stack/data/nova/instances/ee4d14ad-8bd2-4b8b-9526-51abafe757f2/console.log {{(pid=98967) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 26 10:38:48.713835 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:48.715440 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:48.715765 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:48.754167 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-9af07916-b028-4c08-905a-3651d393d7a8 req-46d2ec6d-8496-4b98-8185-dbc428eaf952 service nova] Releasing lock "refresh_cache-c8aff61a-5f59-4f8c-8288-abd5a7853474" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:38:48.754758 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquired lock "refresh_cache-c8aff61a-5f59-4f8c-8288-abd5a7853474" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:38:48.754934 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:38:48.809545 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-3006b083-fd66-462c-8a17-1d90d333de03 req-b1206deb-9f89-4e3e-8e90-adeb736bdae3 service nova] Releasing lock "refresh_cache-c1043abd-b0c0-439e-b065-8bef627483cb" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:38:48.809927 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-3006b083-fd66-462c-8a17-1d90d333de03 req-b1206deb-9f89-4e3e-8e90-adeb736bdae3 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-changed-dcce8bc4-9171-4ef4-b762-37d89aea863b {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:48.809927 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-3006b083-fd66-462c-8a17-1d90d333de03 req-b1206deb-9f89-4e3e-8e90-adeb736bdae3 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Refreshing instance network info cache due to event network-changed-dcce8bc4-9171-4ef4-b762-37d89aea863b. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:38:48.810093 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-3006b083-fd66-462c-8a17-1d90d333de03 req-b1206deb-9f89-4e3e-8e90-adeb736bdae3 service nova] Acquiring lock "refresh_cache-ee4d14ad-8bd2-4b8b-9526-51abafe757f2" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:38:48.844936 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-267d5697-df05-4d7b-9d88-5fa93836da0b req-a58b59f4-dfc6-4740-8989-a1f62ba1d604 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:48.924055 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Successfully updated port: 8d782392-1caa-4b0a-b7e2-58c03357a004 {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:38:48.964331 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-267d5697-df05-4d7b-9d88-5fa93836da0b req-a58b59f4-dfc6-4740-8989-a1f62ba1d604 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:38:49.041312 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:49.070213 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-7c0457c8-fa6d-4c86-b105-47c7b2e617a5 tempest-AttachSCSIVolumeTestJSON-1664188932 tempest-AttachSCSIVolumeTestJSON-1664188932-project-member] [instance: a686feac-bebe-47c8-a3c8-f3c2260ca7f5] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:49.097072 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:49.210361 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-267d5697-df05-4d7b-9d88-5fa93836da0b req-a58b59f4-dfc6-4740-8989-a1f62ba1d604 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:38:49.220662 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Creating config drive at /opt/stack/data/nova/instances/0ae0d213-f58c-4ee5-844f-960b16a5a95b/disk.config Jun 26 10:38:49.223604 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/0ae0d213-f58c-4ee5-844f-960b16a5a95b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpr_tjo529 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:49.277814 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/0ae0d213-f58c-4ee5-844f-960b16a5a95b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpr_tjo529" returned: 0 in 0.054s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:49.338576 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:38:49.338893 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:38:49.373339 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:38:49.447916 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-d20c9b07-5d05-43e5-8c65-2eed59623d0b req-09ab03ae-2520-4ee3-b402-fb0073851c9b service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-changed-8d782392-1caa-4b0a-b7e2-58c03357a004 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:49.447916 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-d20c9b07-5d05-43e5-8c65-2eed59623d0b req-09ab03ae-2520-4ee3-b402-fb0073851c9b service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Refreshing instance network info cache due to event network-changed-8d782392-1caa-4b0a-b7e2-58c03357a004. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:38:49.447916 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-d20c9b07-5d05-43e5-8c65-2eed59623d0b req-09ab03ae-2520-4ee3-b402-fb0073851c9b service nova] Acquiring lock "refresh_cache-ee4d14ad-8bd2-4b8b-9526-51abafe757f2" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:38:49.715897 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-267d5697-df05-4d7b-9d88-5fa93836da0b req-a58b59f4-dfc6-4740-8989-a1f62ba1d604 service nova] Releasing lock "refresh_cache-ee4d14ad-8bd2-4b8b-9526-51abafe757f2" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:38:49.716292 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-3006b083-fd66-462c-8a17-1d90d333de03 req-b1206deb-9f89-4e3e-8e90-adeb736bdae3 service nova] Acquired lock "refresh_cache-ee4d14ad-8bd2-4b8b-9526-51abafe757f2" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:38:49.716483 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-3006b083-fd66-462c-8a17-1d90d333de03 req-b1206deb-9f89-4e3e-8e90-adeb736bdae3 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Refreshing network info cache for port dcce8bc4-9171-4ef4-b762-37d89aea863b {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:38:49.776327 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:49.806379 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:49.843901 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:38:49.919469 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:50.073663 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:50.182844 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:50.187423 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:50.219289 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:50.220108 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-3006b083-fd66-462c-8a17-1d90d333de03 req-b1206deb-9f89-4e3e-8e90-adeb736bdae3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:50.334453 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Successfully updated port: 45a4f3f8-69ee-4cc0-811e-a1178c8b18f2 {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:38:50.357592 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.784s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:50.358343 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Start building networks asynchronously for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 26 10:38:50.434031 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:50.555027 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-3006b083-fd66-462c-8a17-1d90d333de03 req-b1206deb-9f89-4e3e-8e90-adeb736bdae3 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:38:50.803956 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Updating instance_info_cache with network_info: [{"id": "93123956-587e-4fec-b4de-833327660f6e", "address": "fa:16:3e:78:44:6c", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93123956-58", "ovs_interfaceid": "93123956-587e-4fec-b4de-833327660f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:38:50.867696 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Allocating IP information in the background. {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 26 10:38:50.867696 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] allocate_for_instance() {{(pid=98967) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 26 10:38:50.868140 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:50.868140 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:50.943523 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-3006b083-fd66-462c-8a17-1d90d333de03 req-b1206deb-9f89-4e3e-8e90-adeb736bdae3 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:38:50.965471 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:38:50.965602 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] VM Started (Lifecycle Event) Jun 26 10:38:51.008452 np0000003731 nova-compute[98967]: DEBUG nova.policy [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '8a8a0b0240a34fb0bcf62ee7ec259cb2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '49c2798faed447838b6c87f6d15cce66', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98967) authorize /opt/stack/nova/nova/policy.py:192}} Jun 26 10:38:51.311882 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Releasing lock "refresh_cache-c8aff61a-5f59-4f8c-8288-abd5a7853474" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:38:51.311882 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Instance network_info: |[{"id": "93123956-587e-4fec-b4de-833327660f6e", "address": "fa:16:3e:78:44:6c", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93123956-58", "ovs_interfaceid": "93123956-587e-4fec-b4de-833327660f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 26 10:38:51.311882 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Start _get_guest_xml network_info=[{"id": "93123956-587e-4fec-b4de-833327660f6e", "address": "fa:16:3e:78:44:6c", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93123956-58", "ovs_interfaceid": "93123956-587e-4fec-b4de-833327660f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'image_id': 'a9b18127-6fee-4ed6-b364-a2d634ecb8b7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:38:51.311882 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:38:51.311882 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-478371896', uuid='c8aff61a-5f59-4f8c-8288-abd5a7853474'), owner=OwnerMeta(userid='04176251e13046eb8cfc1908246d4d9d', username='tempest-ServerRescueNegativeTestJSON-1439990304-project-member', projectid='58a58b94e5ec406182da9117e14aa789', projectname='tempest-ServerRescueNegativeTestJSON-1439990304'), image=ImageMeta(id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "93123956-587e-4fec-b4de-833327660f6e", "address": "fa:16:3e:78:44:6c", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93123956-58", "ovs_interfaceid": "93123956-587e-4fec-b4de-833327660f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470331.310472) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:38:51.311882 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:38:51.312282 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:38:51.314326 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:38:51.314326 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:38:51.314326 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:38:51.314326 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:38:51.319425 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:38:51.319425 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:38:51.319425 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:38:51.319425 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:38:51.319425 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:38:51.319425 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:38:51.319425 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:38:51.319425 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:38:51.319425 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:38:51.319425 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:38:51.336368 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:38:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-478371896',display_name='tempest-ServerRescueNegativeTestJSON-server-478371896',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-serverrescuenegativetestjson-server-478371896',id=17,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+OGQ8Eo1x4iFVwcFj09jg9sQh3dFHv74SAS4ZWyaekKEeCWVFry7SNIL4HTxAbAqZ7ppe/G6qaUIGoSh5uKAL1TZC+RDK6nNG7j6kwengqZDEKTSAcP05cc2XBMrVz9A==',key_name='tempest-keypair-1478353236',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='58a58b94e5ec406182da9117e14aa789',ramdisk_id='',reservation_id='r-vvq7102i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1439990304',owner_user_name='tempest-ServerRescueNegativeTestJSON-1439990304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:38:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04176251e13046eb8cfc1908246d4d9d',uuid=c8aff61a-5f59-4f8c-8288-abd5a7853474,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93123956-587e-4fec-b4de-833327660f6e", "address": "fa:16:3e:78:44:6c", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93123956-58", "ovs_interfaceid": "93123956-587e-4fec-b4de-833327660f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:38:51.336368 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Converting VIF {"id": "93123956-587e-4fec-b4de-833327660f6e", "address": "fa:16:3e:78:44:6c", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93123956-58", "ovs_interfaceid": "93123956-587e-4fec-b4de-833327660f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:38:51.336368 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:44:6c,bridge_name='br-int',has_traffic_filtering=True,id=93123956-587e-4fec-b4de-833327660f6e,network=Network(d50baa85-72ef-4bb3-9676-e629d583d3a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93123956-58') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:38:51.336368 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'pci_devices' on Instance uuid c8aff61a-5f59-4f8c-8288-abd5a7853474 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:51.370440 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 26 10:38:51.455039 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-3006b083-fd66-462c-8a17-1d90d333de03 req-b1206deb-9f89-4e3e-8e90-adeb736bdae3 service nova] Releasing lock "refresh_cache-ee4d14ad-8bd2-4b8b-9526-51abafe757f2" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:38:51.455039 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-d20c9b07-5d05-43e5-8c65-2eed59623d0b req-09ab03ae-2520-4ee3-b402-fb0073851c9b service nova] Acquired lock "refresh_cache-ee4d14ad-8bd2-4b8b-9526-51abafe757f2" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:38:51.455039 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-d20c9b07-5d05-43e5-8c65-2eed59623d0b req-09ab03ae-2520-4ee3-b402-fb0073851c9b service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Refreshing network info cache for port 8d782392-1caa-4b0a-b7e2-58c03357a004 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:38:51.472606 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:51.472606 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Paused> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:38:51.472606 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] VM Paused (Lifecycle Event) Jun 26 10:38:51.543844 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-3a7154ea-4d93-4450-8cce-5b26657d90a2 req-c9ba844a-8098-41de-98c2-2f6a25808d04 service nova] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Received event network-vif-plugged-91b09012-11f2-4c26-a3c5-80cff99fe65e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:51.543844 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-3a7154ea-4d93-4450-8cce-5b26657d90a2 req-c9ba844a-8098-41de-98c2-2f6a25808d04 service nova] Acquiring lock "0ae0d213-f58c-4ee5-844f-960b16a5a95b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:51.543844 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-3a7154ea-4d93-4450-8cce-5b26657d90a2 req-c9ba844a-8098-41de-98c2-2f6a25808d04 service nova] Lock "0ae0d213-f58c-4ee5-844f-960b16a5a95b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:51.543844 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-3a7154ea-4d93-4450-8cce-5b26657d90a2 req-c9ba844a-8098-41de-98c2-2f6a25808d04 service nova] Lock "0ae0d213-f58c-4ee5-844f-960b16a5a95b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:51.543844 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-3a7154ea-4d93-4450-8cce-5b26657d90a2 req-c9ba844a-8098-41de-98c2-2f6a25808d04 service nova] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Processing event network-vif-plugged-91b09012-11f2-4c26-a3c5-80cff99fe65e {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:38:51.543844 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-3a7154ea-4d93-4450-8cce-5b26657d90a2 req-c9ba844a-8098-41de-98c2-2f6a25808d04 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-changed-45a4f3f8-69ee-4cc0-811e-a1178c8b18f2 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:51.543844 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-3a7154ea-4d93-4450-8cce-5b26657d90a2 req-c9ba844a-8098-41de-98c2-2f6a25808d04 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Refreshing instance network info cache due to event network-changed-45a4f3f8-69ee-4cc0-811e-a1178c8b18f2. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:38:51.543844 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-3a7154ea-4d93-4450-8cce-5b26657d90a2 req-c9ba844a-8098-41de-98c2-2f6a25808d04 service nova] Acquiring lock "refresh_cache-ee4d14ad-8bd2-4b8b-9526-51abafe757f2" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:38:51.543844 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:38:51.553614 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Guest created on hypervisor {{(pid=98967) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 26 10:38:51.557039 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Instance spawned successfully. Jun 26 10:38:51.557039 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 26 10:38:51.636905 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-ee7f7ee8-7fa8-4d4e-b67a-6cbe9599f5dd req-5bdb46cd-5a2d-466e-a457-8c59a370f259 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Received event network-vif-unplugged-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:51.654266 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-ee7f7ee8-7fa8-4d4e-b67a-6cbe9599f5dd req-5bdb46cd-5a2d-466e-a457-8c59a370f259 service nova] Acquiring lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:51.654266 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-ee7f7ee8-7fa8-4d4e-b67a-6cbe9599f5dd req-5bdb46cd-5a2d-466e-a457-8c59a370f259 service nova] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:51.654266 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-ee7f7ee8-7fa8-4d4e-b67a-6cbe9599f5dd req-5bdb46cd-5a2d-466e-a457-8c59a370f259 service nova] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:51.654266 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-ee7f7ee8-7fa8-4d4e-b67a-6cbe9599f5dd req-5bdb46cd-5a2d-466e-a457-8c59a370f259 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] No waiting events found dispatching network-vif-unplugged-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:51.654266 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-ee7f7ee8-7fa8-4d4e-b67a-6cbe9599f5dd req-5bdb46cd-5a2d-466e-a457-8c59a370f259 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Received unexpected event network-vif-unplugged-93123956-587e-4fec-b4de-833327660f6e for instance with vm_state building and task_state spawning. Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] End _get_guest_xml xml= Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: c8aff61a-5f59-4f8c-8288-abd5a7853474 Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: instance-00000011 Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: 196608 Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: tempest-ServerRescueNegativeTestJSON-server-478371896 Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: 2026-06-26 10:38:51 Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: 192 Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: 0 Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: 0 Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: True Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: bare Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: 0 Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: virtio Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: tempest-ServerRescueNegativeTestJSON-1439990304-project-member Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: tempest-ServerRescueNegativeTestJSON-1439990304 Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: c8aff61a-5f59-4f8c-8288-abd5a7853474 Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: c8aff61a-5f59-4f8c-8288-abd5a7853474 Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: hvm Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: 128 Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: Jun 26 10:38:51.838499 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:38:51.840587 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Preparing to wait for external event network-vif-plugged-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:38:51.840587 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:51.840587 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:51.840587 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:51.840587 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:38:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-478371896',display_name='tempest-ServerRescueNegativeTestJSON-server-478371896',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-serverrescuenegativetestjson-server-478371896',id=17,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+OGQ8Eo1x4iFVwcFj09jg9sQh3dFHv74SAS4ZWyaekKEeCWVFry7SNIL4HTxAbAqZ7ppe/G6qaUIGoSh5uKAL1TZC+RDK6nNG7j6kwengqZDEKTSAcP05cc2XBMrVz9A==',key_name='tempest-keypair-1478353236',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='58a58b94e5ec406182da9117e14aa789',ramdisk_id='',reservation_id='r-vvq7102i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerRescueNegativeTestJSON-1439990304',owner_user_name='tempest-ServerRescueNegativeTestJSON-1439990304-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:38:47Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04176251e13046eb8cfc1908246d4d9d',uuid=c8aff61a-5f59-4f8c-8288-abd5a7853474,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "93123956-587e-4fec-b4de-833327660f6e", "address": "fa:16:3e:78:44:6c", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93123956-58", "ovs_interfaceid": "93123956-587e-4fec-b4de-833327660f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:38:51.840587 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Converting VIF {"id": "93123956-587e-4fec-b4de-833327660f6e", "address": "fa:16:3e:78:44:6c", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93123956-58", "ovs_interfaceid": "93123956-587e-4fec-b4de-833327660f6e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:38:51.840903 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:78:44:6c,bridge_name='br-int',has_traffic_filtering=True,id=93123956-587e-4fec-b4de-833327660f6e,network=Network(d50baa85-72ef-4bb3-9676-e629d583d3a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93123956-58') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:38:51.840940 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:44:6c,bridge_name='br-int',has_traffic_filtering=True,id=93123956-587e-4fec-b4de-833327660f6e,network=Network(d50baa85-72ef-4bb3-9676-e629d583d3a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93123956-58') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:38:51.841350 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:51.841701 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:51.856190 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:38:51.856190 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:51.856190 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a4c9dc7e-2243-587f-afa7-09fe3bed4b86', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:51.856190 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:51.856190 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:51.856190 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:51.856190 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:51.856190 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap93123956-58, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:51.856190 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap93123956-58, col_values=(('qos', UUID('8972ad5b-41a8-48bc-b92f-d13ac0f2cad8')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:51.856190 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap93123956-58, col_values=(('external_ids', {'iface-id': '93123956-587e-4fec-b4de-833327660f6e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:78:44:6c', 'vm-uuid': 'c8aff61a-5f59-4f8c-8288-abd5a7853474'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:51.856190 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:51.856190 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:51.858912 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:51.861653 np0000003731 nova-compute[98967]: INFO os_vif [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:78:44:6c,bridge_name='br-int',has_traffic_filtering=True,id=93123956-587e-4fec-b4de-833327660f6e,network=Network(d50baa85-72ef-4bb3-9676-e629d583d3a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93123956-58') Jun 26 10:38:51.881087 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Start building block device mappings for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 26 10:38:51.946174 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-d20c9b07-5d05-43e5-8c65-2eed59623d0b req-09ab03ae-2520-4ee3-b402-fb0073851c9b service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:51.975964 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:51.983985 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:38:51.984145 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] VM Resumed (Lifecycle Event) Jun 26 10:38:52.073484 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Found default for hw_cdrom_bus of ide {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:38:52.073484 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Found default for hw_disk_bus of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:38:52.073484 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Found default for hw_input_bus of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:38:52.073484 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Found default for hw_pointer_model of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:38:52.073484 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Found default for hw_video_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:38:52.073484 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Found default for hw_vif_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:38:52.276367 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Successfully updated port: c2ff0bc1-8b84-4517-b347-f78bb6a9e14c {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:38:52.371679 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:52.384489 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-ea30e760-fb75-436d-97ee-fe3c9f31b265 req-4059ead5-09d2-4eb0-9dec-d213807955a5 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-changed-c2ff0bc1-8b84-4517-b347-f78bb6a9e14c {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:52.384489 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-ea30e760-fb75-436d-97ee-fe3c9f31b265 req-4059ead5-09d2-4eb0-9dec-d213807955a5 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Refreshing instance network info cache due to event network-changed-c2ff0bc1-8b84-4517-b347-f78bb6a9e14c. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:38:52.384489 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-ea30e760-fb75-436d-97ee-fe3c9f31b265 req-4059ead5-09d2-4eb0-9dec-d213807955a5 service nova] Acquiring lock "refresh_cache-ee4d14ad-8bd2-4b8b-9526-51abafe757f2" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:38:52.429319 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:52.461360 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-d20c9b07-5d05-43e5-8c65-2eed59623d0b req-09ab03ae-2520-4ee3-b402-fb0073851c9b service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:38:52.487761 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:52.489294 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:38:52.573513 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Took 7.54 seconds to spawn the instance on the hypervisor. Jun 26 10:38:52.573665 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:52.781071 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Acquiring lock "refresh_cache-ee4d14ad-8bd2-4b8b-9526-51abafe757f2" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:38:52.788156 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-d20c9b07-5d05-43e5-8c65-2eed59623d0b req-09ab03ae-2520-4ee3-b402-fb0073851c9b service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:38:52.890560 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Start spawning the instance on the hypervisor. {{(pid=98967) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 26 10:38:52.891422 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Creating instance directory {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 26 10:38:52.891682 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Creating image(s) Jun 26 10:38:52.892148 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "/opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:52.892289 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "/opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:52.892653 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "/opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:52.893175 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:52.914032 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:52.916080 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:52.993000 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] During sync_power_state the instance has a pending task (spawning). Skip. Jun 26 10:38:53.009661 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.094s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:53.010178 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:53.010765 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:53.011397 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:53.018739 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:53.018739 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:53.085986 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Took 13.96 seconds to build instance. Jun 26 10:38:53.099882 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.079s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:53.100818 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/disk 1073741824 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:53.178870 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/disk 1073741824" returned: 0 in 0.078s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:53.179367 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.169s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:53.179716 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:53.209187 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Successfully created port: b747180c-b090-4936-90bc-0c6553817170 {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:38:53.273096 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.093s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:53.273428 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Checking if we can resize image /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/disk. size=1073741824 {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 26 10:38:53.273721 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:53.298142 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-d20c9b07-5d05-43e5-8c65-2eed59623d0b req-09ab03ae-2520-4ee3-b402-fb0073851c9b service nova] Releasing lock "refresh_cache-ee4d14ad-8bd2-4b8b-9526-51abafe757f2" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:38:53.298142 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-3a7154ea-4d93-4450-8cce-5b26657d90a2 req-c9ba844a-8098-41de-98c2-2f6a25808d04 service nova] Acquired lock "refresh_cache-ee4d14ad-8bd2-4b8b-9526-51abafe757f2" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:38:53.298142 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-3a7154ea-4d93-4450-8cce-5b26657d90a2 req-c9ba844a-8098-41de-98c2-2f6a25808d04 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Refreshing network info cache for port 45a4f3f8-69ee-4cc0-811e-a1178c8b18f2 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:38:53.363778 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:53.377904 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:53.378238 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Cannot resize image /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/disk to a smaller size. {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 26 10:38:53.378526 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Created local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 26 10:38:53.378702 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Ensure instance console log exists: /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/console.log {{(pid=98967) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 26 10:38:53.378936 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:53.379181 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:53.379297 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:53.431548 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:38:53.431678 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:38:53.452765 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] No VIF found with MAC fa:16:3e:78:44:6c, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:38:53.452765 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Using config drive Jun 26 10:38:53.587721 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-af78e701-c300-43a8-81c0-1ce3b69cc1a8 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "0ae0d213-f58c-4ee5-844f-960b16a5a95b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.478s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:53.799809 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-3a7154ea-4d93-4450-8cce-5b26657d90a2 req-c9ba844a-8098-41de-98c2-2f6a25808d04 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:53.928437 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-3a7154ea-4d93-4450-8cce-5b26657d90a2 req-c9ba844a-8098-41de-98c2-2f6a25808d04 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:38:53.939297 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:54.099609 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Successfully updated port: b747180c-b090-4936-90bc-0c6553817170 {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:38:54.162852 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-72d4e094-5f29-46cd-acf5-1f26bd3fb0ba req-1bd9aa74-ae55-47c7-bc6e-19878d99542d service nova] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Received event network-changed-b747180c-b090-4936-90bc-0c6553817170 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:54.162852 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-72d4e094-5f29-46cd-acf5-1f26bd3fb0ba req-1bd9aa74-ae55-47c7-bc6e-19878d99542d service nova] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Refreshing instance network info cache due to event network-changed-b747180c-b090-4936-90bc-0c6553817170. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:38:54.162852 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-72d4e094-5f29-46cd-acf5-1f26bd3fb0ba req-1bd9aa74-ae55-47c7-bc6e-19878d99542d service nova] Acquiring lock "refresh_cache-f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:38:54.163049 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-72d4e094-5f29-46cd-acf5-1f26bd3fb0ba req-1bd9aa74-ae55-47c7-bc6e-19878d99542d service nova] Acquired lock "refresh_cache-f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:38:54.163049 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-72d4e094-5f29-46cd-acf5-1f26bd3fb0ba req-1bd9aa74-ae55-47c7-bc6e-19878d99542d service nova] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Refreshing network info cache for port b747180c-b090-4936-90bc-0c6553817170 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:38:54.179663 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Creating config drive at /opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474/disk.config Jun 26 10:38:54.194820 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj3s2t0yg {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:54.246570 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpj3s2t0yg" returned: 0 in 0.051s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:54.278908 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-3a7154ea-4d93-4450-8cce-5b26657d90a2 req-c9ba844a-8098-41de-98c2-2f6a25808d04 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:38:54.601656 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "refresh_cache-f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:38:54.666467 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-72d4e094-5f29-46cd-acf5-1f26bd3fb0ba req-1bd9aa74-ae55-47c7-bc6e-19878d99542d service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:54.685486 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:54.719354 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:54.781081 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-3a7154ea-4d93-4450-8cce-5b26657d90a2 req-c9ba844a-8098-41de-98c2-2f6a25808d04 service nova] Releasing lock "refresh_cache-ee4d14ad-8bd2-4b8b-9526-51abafe757f2" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:38:54.781295 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-3a7154ea-4d93-4450-8cce-5b26657d90a2 req-c9ba844a-8098-41de-98c2-2f6a25808d04 service nova] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Received event network-vif-plugged-91b09012-11f2-4c26-a3c5-80cff99fe65e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:54.781804 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-ea30e760-fb75-436d-97ee-fe3c9f31b265 req-4059ead5-09d2-4eb0-9dec-d213807955a5 service nova] Acquired lock "refresh_cache-ee4d14ad-8bd2-4b8b-9526-51abafe757f2" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:38:54.782041 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-3a7154ea-4d93-4450-8cce-5b26657d90a2 req-c9ba844a-8098-41de-98c2-2f6a25808d04 service nova] Acquiring lock "0ae0d213-f58c-4ee5-844f-960b16a5a95b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:54.782277 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-ea30e760-fb75-436d-97ee-fe3c9f31b265 req-4059ead5-09d2-4eb0-9dec-d213807955a5 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Refreshing network info cache for port c2ff0bc1-8b84-4517-b347-f78bb6a9e14c {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:38:54.782780 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-3a7154ea-4d93-4450-8cce-5b26657d90a2 req-c9ba844a-8098-41de-98c2-2f6a25808d04 service nova] Lock "0ae0d213-f58c-4ee5-844f-960b16a5a95b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:54.783497 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-3a7154ea-4d93-4450-8cce-5b26657d90a2 req-c9ba844a-8098-41de-98c2-2f6a25808d04 service nova] Lock "0ae0d213-f58c-4ee5-844f-960b16a5a95b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:54.783753 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-3a7154ea-4d93-4450-8cce-5b26657d90a2 req-c9ba844a-8098-41de-98c2-2f6a25808d04 service nova] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] No waiting events found dispatching network-vif-plugged-91b09012-11f2-4c26-a3c5-80cff99fe65e {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:54.783882 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-3a7154ea-4d93-4450-8cce-5b26657d90a2 req-c9ba844a-8098-41de-98c2-2f6a25808d04 service nova] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Received unexpected event network-vif-plugged-91b09012-11f2-4c26-a3c5-80cff99fe65e for instance with vm_state building and task_state spawning. Jun 26 10:38:54.807837 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-72d4e094-5f29-46cd-acf5-1f26bd3fb0ba req-1bd9aa74-ae55-47c7-bc6e-19878d99542d service nova] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:38:54.810082 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:54.867975 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:54.871980 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:55.051885 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-491ab51e-b2cf-47be-9ecb-8fdfb557b155 req-64a5c226-2e61-4803-b0c7-ce1c477daaaf service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Received event network-vif-plugged-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:55.052464 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-491ab51e-b2cf-47be-9ecb-8fdfb557b155 req-64a5c226-2e61-4803-b0c7-ce1c477daaaf service nova] Acquiring lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:55.052734 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-491ab51e-b2cf-47be-9ecb-8fdfb557b155 req-64a5c226-2e61-4803-b0c7-ce1c477daaaf service nova] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:55.053282 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-491ab51e-b2cf-47be-9ecb-8fdfb557b155 req-64a5c226-2e61-4803-b0c7-ce1c477daaaf service nova] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:55.053282 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-491ab51e-b2cf-47be-9ecb-8fdfb557b155 req-64a5c226-2e61-4803-b0c7-ce1c477daaaf service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Processing event network-vif-plugged-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:38:55.081116 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-72d4e094-5f29-46cd-acf5-1f26bd3fb0ba req-1bd9aa74-ae55-47c7-bc6e-19878d99542d service nova] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:38:55.284743 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-ea30e760-fb75-436d-97ee-fe3c9f31b265 req-4059ead5-09d2-4eb0-9dec-d213807955a5 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:55.451395 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-ea30e760-fb75-436d-97ee-fe3c9f31b265 req-4059ead5-09d2-4eb0-9dec-d213807955a5 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:38:55.594715 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-72d4e094-5f29-46cd-acf5-1f26bd3fb0ba req-1bd9aa74-ae55-47c7-bc6e-19878d99542d service nova] Releasing lock "refresh_cache-f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:38:55.594715 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquired lock "refresh_cache-f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:38:55.594715 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:38:55.683283 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-ea30e760-fb75-436d-97ee-fe3c9f31b265 req-4059ead5-09d2-4eb0-9dec-d213807955a5 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:38:56.121187 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:38:56.121821 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:38:56.121821 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] VM Started (Lifecycle Event) Jun 26 10:38:56.123836 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Guest created on hypervisor {{(pid=98967) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 26 10:38:56.131188 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Instance spawned successfully. Jun 26 10:38:56.134784 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 26 10:38:56.180414 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:38:56.188234 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-ea30e760-fb75-436d-97ee-fe3c9f31b265 req-4059ead5-09d2-4eb0-9dec-d213807955a5 service nova] Releasing lock "refresh_cache-ee4d14ad-8bd2-4b8b-9526-51abafe757f2" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:38:56.188234 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Acquired lock "refresh_cache-ee4d14ad-8bd2-4b8b-9526-51abafe757f2" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:38:56.188234 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:38:56.340824 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-8662162d-3d78-4672-b683-51dc07a2d038 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:56.372551 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:56.567406 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Updating instance_info_cache with network_info: [{"id": "b747180c-b090-4936-90bc-0c6553817170", "address": "fa:16:3e:43:d8:28", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb747180c-b0", "ovs_interfaceid": "b747180c-b090-4936-90bc-0c6553817170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:38:56.627582 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:56.629540 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:38:56.648056 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Found default for hw_cdrom_bus of ide {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:38:56.648193 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Found default for hw_disk_bus of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:38:56.648945 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Found default for hw_input_bus of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:38:56.648996 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Found default for hw_pointer_model of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:38:56.649362 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Found default for hw_video_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:38:56.649726 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Found default for hw_vif_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:38:56.788350 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:38:56.848300 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-8662162d-3d78-4672-b683-51dc07a2d038 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] instance snapshotting Jun 26 10:38:56.850889 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:56.971183 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-8662162d-3d78-4672-b683-51dc07a2d038 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Beginning live snapshot process Jun 26 10:38:57.069921 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Releasing lock "refresh_cache-f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:38:57.069921 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Instance network_info: |[{"id": "b747180c-b090-4936-90bc-0c6553817170", "address": "fa:16:3e:43:d8:28", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb747180c-b0", "ovs_interfaceid": "b747180c-b090-4936-90bc-0c6553817170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 26 10:38:57.071249 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Start _get_guest_xml network_info=[{"id": "b747180c-b090-4936-90bc-0c6553817170", "address": "fa:16:3e:43:d8:28", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb747180c-b0", "ovs_interfaceid": "b747180c-b090-4936-90bc-0c6553817170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'image_id': 'a9b18127-6fee-4ed6-b364-a2d634ecb8b7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:38:57.074296 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:57.078681 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:38:57.079875 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='multiattach-server-1', uuid='f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d'), owner=OwnerMeta(userid='8a8a0b0240a34fb0bcf62ee7ec259cb2', username='tempest-AttachVolumeMultiAttachTest-1668992443-project-member', projectid='49c2798faed447838b6c87f6d15cce66', projectname='tempest-AttachVolumeMultiAttachTest-1668992443'), image=ImageMeta(id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b747180c-b090-4936-90bc-0c6553817170", "address": "fa:16:3e:43:d8:28", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb747180c-b0", "ovs_interfaceid": "b747180c-b090-4936-90bc-0c6553817170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470337.0795496) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:38:57.082317 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:38:57.082612 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:38:57.083393 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:38:57.083560 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:38:57.084420 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:38:57.084725 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:38:57.084880 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:38:57.084974 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:38:57.085140 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:38:57.085219 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:38:57.085343 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:38:57.085440 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:38:57.085540 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:38:57.085649 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:38:57.085742 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:38:57.085852 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:38:57.097100 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:38:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='multiattach-server-1',id=18,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIANZiDTtI5cmApVvRJAaLuw+rm1nR4eCOZjHwVoNWhAR53DFExlyLfMWz+jjXnkCXdfpUcLxD2eMk9e+d1HV7SCzQccChfvPKV4jw2Mlc92UdPlKs2IxpAJWXP9L/ysw==',key_name='tempest-keypair-1990365436',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49c2798faed447838b6c87f6d15cce66',ramdisk_id='',reservation_id='r-vx44ocjv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1668992443',owner_user_name='tempest-AttachVolumeMultiAttachTest-1668992443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:38:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a8a0b0240a34fb0bcf62ee7ec259cb2',uuid=f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b747180c-b090-4936-90bc-0c6553817170", "address": "fa:16:3e:43:d8:28", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb747180c-b0", "ovs_interfaceid": "b747180c-b090-4936-90bc-0c6553817170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:38:57.097315 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Converting VIF {"id": "b747180c-b090-4936-90bc-0c6553817170", "address": "fa:16:3e:43:d8:28", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb747180c-b0", "ovs_interfaceid": "b747180c-b090-4936-90bc-0c6553817170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:38:57.097919 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:d8:28,bridge_name='br-int',has_traffic_filtering=True,id=b747180c-b090-4936-90bc-0c6553817170,network=Network(204eb6a3-9452-412e-ab0b-1594eb86bed2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb747180c-b0') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:38:57.098456 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lazy-loading 'pci_devices' on Instance uuid f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:38:57.134819 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-81a6ad63-3807-4727-81e7-37d2ec62be66 req-781d0752-fe07-423f-9637-936b67ad92af service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Received event network-vif-plugged-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:57.134819 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-81a6ad63-3807-4727-81e7-37d2ec62be66 req-781d0752-fe07-423f-9637-936b67ad92af service nova] Acquiring lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:57.134819 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-81a6ad63-3807-4727-81e7-37d2ec62be66 req-781d0752-fe07-423f-9637-936b67ad92af service nova] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:57.134819 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-81a6ad63-3807-4727-81e7-37d2ec62be66 req-781d0752-fe07-423f-9637-936b67ad92af service nova] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:57.134819 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-81a6ad63-3807-4727-81e7-37d2ec62be66 req-781d0752-fe07-423f-9637-936b67ad92af service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] No waiting events found dispatching network-vif-plugged-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:38:57.134819 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-81a6ad63-3807-4727-81e7-37d2ec62be66 req-781d0752-fe07-423f-9637-936b67ad92af service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Received unexpected event network-vif-plugged-93123956-587e-4fec-b4de-833327660f6e for instance with vm_state building and task_state spawning. Jun 26 10:38:57.134819 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] During sync_power_state the instance has a pending task (spawning). Skip. Jun 26 10:38:57.134819 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Paused> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:38:57.134819 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] VM Paused (Lifecycle Event) Jun 26 10:38:57.157857 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Took 9.32 seconds to spawn the instance on the hypervisor. Jun 26 10:38:57.157857 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:57.426122 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:57.541972 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] End _get_guest_xml xml= Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: instance-00000012 Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: 196608 Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: multiattach-server-1 Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: 2026-06-26 10:38:57 Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: 192 Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: 0 Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: 0 Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: True Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: bare Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: 0 Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: virtio Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: tempest-AttachVolumeMultiAttachTest-1668992443-project-member Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: tempest-AttachVolumeMultiAttachTest-1668992443 Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: hvm Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: 128 Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: 1 Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: Jun 26 10:38:57.602117 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:38:57.615964 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Preparing to wait for external event network-vif-plugged-b747180c-b090-4936-90bc-0c6553817170 {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:38:57.615964 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:57.615964 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:57.615964 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:57.615964 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:38:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='multiattach-server-1',id=18,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIANZiDTtI5cmApVvRJAaLuw+rm1nR4eCOZjHwVoNWhAR53DFExlyLfMWz+jjXnkCXdfpUcLxD2eMk9e+d1HV7SCzQccChfvPKV4jw2Mlc92UdPlKs2IxpAJWXP9L/ysw==',key_name='tempest-keypair-1990365436',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='49c2798faed447838b6c87f6d15cce66',ramdisk_id='',reservation_id='r-vx44ocjv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeMultiAttachTest-1668992443',owner_user_name='tempest-AttachVolumeMultiAttachTest-1668992443-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:38:52Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a8a0b0240a34fb0bcf62ee7ec259cb2',uuid=f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b747180c-b090-4936-90bc-0c6553817170", "address": "fa:16:3e:43:d8:28", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb747180c-b0", "ovs_interfaceid": "b747180c-b090-4936-90bc-0c6553817170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:38:57.615964 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Converting VIF {"id": "b747180c-b090-4936-90bc-0c6553817170", "address": "fa:16:3e:43:d8:28", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb747180c-b0", "ovs_interfaceid": "b747180c-b090-4936-90bc-0c6553817170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:38:57.615964 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:43:d8:28,bridge_name='br-int',has_traffic_filtering=True,id=b747180c-b090-4936-90bc-0c6553817170,network=Network(204eb6a3-9452-412e-ab0b-1594eb86bed2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb747180c-b0') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:38:57.615964 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:d8:28,bridge_name='br-int',has_traffic_filtering=True,id=b747180c-b090-4936-90bc-0c6553817170,network=Network(204eb6a3-9452-412e-ab0b-1594eb86bed2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb747180c-b0') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:38:57.615964 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:57.615964 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:57.615964 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:38:57.615964 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:57.615964 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '8df441de-352f-5b8a-b5d1-a5a0e42ff8c8', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:57.615964 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:57.615964 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:57.615964 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:57.615964 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:57.615964 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb747180c-b0, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:57.615964 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb747180c-b0, col_values=(('qos', UUID('346b14e7-e65e-490e-a0fd-e32e6a391028')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:57.615964 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb747180c-b0, col_values=(('external_ids', {'iface-id': 'b747180c-b090-4936-90bc-0c6553817170', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:43:d8:28', 'vm-uuid': 'f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:38:57.615964 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:57.615964 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:38:57.627665 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:57.629542 np0000003731 nova-compute[98967]: INFO os_vif [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:43:d8:28,bridge_name='br-int',has_traffic_filtering=True,id=b747180c-b090-4936-90bc-0c6553817170,network=Network(204eb6a3-9452-412e-ab0b-1594eb86bed2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb747180c-b0') Jun 26 10:38:57.637246 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:57.647671 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:38:57.647858 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] VM Resumed (Lifecycle Event) Jun 26 10:38:57.668495 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Took 16.82 seconds to build instance. Jun 26 10:38:58.157683 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:38:58.163697 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:38:58.171329 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4cdf50b-ebec-485e-a04a-56945d6ae8e5 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 18.330s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:38:58.180284 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:38:58.443495 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquiring lock "3a56a898-691e-473e-a5c1-d618e861087b" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:58.444244 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "3a56a898-691e-473e-a5c1-d618e861087b" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:58.489461 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-8662162d-3d78-4672-b683-51dc07a2d038 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ae0d213-f58c-4ee5-844f-960b16a5a95b/disk --force-share --output=json -f qcow2 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:58.595085 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-8662162d-3d78-4672-b683-51dc07a2d038 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ae0d213-f58c-4ee5-844f-960b16a5a95b/disk --force-share --output=json -f qcow2" returned: 0 in 0.102s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:58.595085 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-8662162d-3d78-4672-b683-51dc07a2d038 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ae0d213-f58c-4ee5-844f-960b16a5a95b/disk --force-share --output=json -f qcow2 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:58.625346 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:58.707162 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-8662162d-3d78-4672-b683-51dc07a2d038 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ae0d213-f58c-4ee5-844f-960b16a5a95b/disk --force-share --output=json -f qcow2" returned: 0 in 0.113s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:58.708230 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-8662162d-3d78-4672-b683-51dc07a2d038 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:58.715725 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-8662162d-3d78-4672-b683-51dc07a2d038 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:38:58.717677 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-8662162d-3d78-4672-b683-51dc07a2d038 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:58.818034 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-8662162d-3d78-4672-b683-51dc07a2d038 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.102s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:58.820751 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-8662162d-3d78-4672-b683-51dc07a2d038 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbutpygjv/0ba1ad00fe24475ab52e033fa117221e.delta 1073741824 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:58.891848 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-8662162d-3d78-4672-b683-51dc07a2d038 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpbutpygjv/0ba1ad00fe24475ab52e033fa117221e.delta 1073741824" returned: 0 in 0.073s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:58.892745 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-8662162d-3d78-4672-b683-51dc07a2d038 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Quiescing instance not available: QEMU guest agent is not enabled. Jun 26 10:38:58.949035 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Starting instance... {{(pid=98967) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 26 10:38:59.079082 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:59.171935 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:38:59.171935 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:38:59.171935 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No VIF found with MAC fa:16:3e:43:d8:28, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:38:59.171935 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Using config drive Jun 26 10:38:59.191250 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-8662162d-3d78-4672-b683-51dc07a2d038 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98967) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} Jun 26 10:38:59.193334 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-8662162d-3d78-4672-b683-51dc07a2d038 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Skipping quiescing instance: QEMU guest agent is not enabled. Jun 26 10:38:59.253332 np0000003731 nova-compute[98967]: DEBUG nova.privsep.utils [None req-8662162d-3d78-4672-b683-51dc07a2d038 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98967) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 26 10:38:59.254488 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-8662162d-3d78-4672-b683-51dc07a2d038 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbutpygjv/0ba1ad00fe24475ab52e033fa117221e.delta /opt/stack/data/nova/instances/snapshots/tmpbutpygjv/0ba1ad00fe24475ab52e033fa117221e {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:59.387264 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-66a3742f-e45c-4443-beb1-0b1f234b93ab req-f377fb6b-b150-443a-892d-d0ceb35d5ff2 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Received event network-changed-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:38:59.387501 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-66a3742f-e45c-4443-beb1-0b1f234b93ab req-f377fb6b-b150-443a-892d-d0ceb35d5ff2 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Refreshing instance network info cache due to event network-changed-93123956-587e-4fec-b4de-833327660f6e. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:38:59.387804 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-66a3742f-e45c-4443-beb1-0b1f234b93ab req-f377fb6b-b150-443a-892d-d0ceb35d5ff2 service nova] Acquiring lock "refresh_cache-c8aff61a-5f59-4f8c-8288-abd5a7853474" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:38:59.387974 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-66a3742f-e45c-4443-beb1-0b1f234b93ab req-f377fb6b-b150-443a-892d-d0ceb35d5ff2 service nova] Acquired lock "refresh_cache-c8aff61a-5f59-4f8c-8288-abd5a7853474" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:38:59.388210 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-66a3742f-e45c-4443-beb1-0b1f234b93ab req-f377fb6b-b150-443a-892d-d0ceb35d5ff2 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Refreshing network info cache for port 93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:38:59.486757 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:59.541639 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:38:59.541639 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:38:59.545514 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98967) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 26 10:38:59.550193 np0000003731 nova-compute[98967]: INFO nova.compute.claims [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Claim successful on node np0000003731 Jun 26 10:38:59.617260 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-8662162d-3d78-4672-b683-51dc07a2d038 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpbutpygjv/0ba1ad00fe24475ab52e033fa117221e.delta /opt/stack/data/nova/instances/snapshots/tmpbutpygjv/0ba1ad00fe24475ab52e033fa117221e" returned: 0 in 0.363s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:38:59.617975 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-8662162d-3d78-4672-b683-51dc07a2d038 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Snapshot extracted, beginning image upload Jun 26 10:38:59.682322 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:59.839480 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Creating config drive at /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/disk.config Jun 26 10:38:59.846557 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:59.855887 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnwu20wq6 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:38:59.893075 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-66a3742f-e45c-4443-beb1-0b1f234b93ab req-f377fb6b-b150-443a-892d-d0ceb35d5ff2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:38:59.906575 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnwu20wq6" returned: 0 in 0.051s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:00.394902 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-66a3742f-e45c-4443-beb1-0b1f234b93ab req-f377fb6b-b150-443a-892d-d0ceb35d5ff2 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:00.440635 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:00.470709 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:00.474345 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:00.607510 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:00.688192 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-66a3742f-e45c-4443-beb1-0b1f234b93ab req-f377fb6b-b150-443a-892d-d0ceb35d5ff2 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Updated VIF entry in instance network info cache for port 93123956-587e-4fec-b4de-833327660f6e. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:39:00.688192 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-66a3742f-e45c-4443-beb1-0b1f234b93ab req-f377fb6b-b150-443a-892d-d0ceb35d5ff2 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Updating instance_info_cache with network_info: [{"id": "93123956-587e-4fec-b4de-833327660f6e", "address": "fa:16:3e:78:44:6c", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93123956-58", "ovs_interfaceid": "93123956-587e-4fec-b4de-833327660f6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:39:00.706162 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:00.818704 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:00.824125 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:01.004761 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Updating instance_info_cache with network_info: [{"id": "49031ae0-122b-4f20-8d73-20048a6ad965", "address": "fa:16:3e:fd:10:20", "network": {"id": "8142386b-fc69-434d-9373-4536e94d3e62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-385739110-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49031ae0-12", "ovs_interfaceid": "49031ae0-122b-4f20-8d73-20048a6ad965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebb9bc95-98ee-43f1-bd95-8a3da5497c72", "address": "fa:16:3e:17:f5:ed", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb9bc95-98", "ovs_interfaceid": "ebb9bc95-98ee-43f1-bd95-8a3da5497c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dcce8bc4-9171-4ef4-b762-37d89aea863b", "address": "fa:16:3e:ec:35:bf", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcce8bc4-91", "ovs_interfaceid": "dcce8bc4-9171-4ef4-b762-37d89aea863b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9882d815-8273-4eb8-937b-a1c1e4af4018", "address": "fa:16:3e:52:9c:9b", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9882d815-82", "ovs_interfaceid": "9882d815-8273-4eb8-937b-a1c1e4af4018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d782392-1caa-4b0a-b7e2-58c03357a004", "address": "fa:16:3e:ac:bc:0b", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d782392-1c", "ovs_interfaceid": "8d782392-1caa-4b0a-b7e2-58c03357a004", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45a4f3f8-69ee-4cc0-811e-a1178c8b18f2", "address": "fa:16:3e:b3:64:e7", "network": {"id": "567865ec-590f-489f-ba94-79b2150230b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-814227769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a4f3f8-69", "ovs_interfaceid": "45a4f3f8-69ee-4cc0-811e-a1178c8b18f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2ff0bc1-8b84-4517-b347-f78bb6a9e14c", "address": "fa:16:3e:6a:a4:65", "network": {"id": "567865ec-590f-489f-ba94-79b2150230b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-814227769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ff0bc1-8b", "ovs_interfaceid": "c2ff0bc1-8b84-4517-b347-f78bb6a9e14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:39:01.189166 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-66a3742f-e45c-4443-beb1-0b1f234b93ab req-f377fb6b-b150-443a-892d-d0ceb35d5ff2 service nova] Releasing lock "refresh_cache-c8aff61a-5f59-4f8c-8288-abd5a7853474" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:39:01.380317 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:39:01.380674 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:39:01.510253 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Releasing lock "refresh_cache-ee4d14ad-8bd2-4b8b-9526-51abafe757f2" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:39:01.510253 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Instance network_info: |[{"id": "49031ae0-122b-4f20-8d73-20048a6ad965", "address": "fa:16:3e:fd:10:20", "network": {"id": "8142386b-fc69-434d-9373-4536e94d3e62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-385739110-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49031ae0-12", "ovs_interfaceid": "49031ae0-122b-4f20-8d73-20048a6ad965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebb9bc95-98ee-43f1-bd95-8a3da5497c72", "address": "fa:16:3e:17:f5:ed", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb9bc95-98", "ovs_interfaceid": "ebb9bc95-98ee-43f1-bd95-8a3da5497c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dcce8bc4-9171-4ef4-b762-37d89aea863b", "address": "fa:16:3e:ec:35:bf", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcce8bc4-91", "ovs_interfaceid": "dcce8bc4-9171-4ef4-b762-37d89aea863b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9882d815-8273-4eb8-937b-a1c1e4af4018", "address": "fa:16:3e:52:9c:9b", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9882d815-82", "ovs_interfaceid": "9882d815-8273-4eb8-937b-a1c1e4af4018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d782392-1caa-4b0a-b7e2-58c03357a004", "address": "fa:16:3e:ac:bc:0b", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d782392-1c", "ovs_interfaceid": "8d782392-1caa-4b0a-b7e2-58c03357a004", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45a4f3f8-69ee-4cc0-811e-a1178c8b18f2", "address": "fa:16:3e:b3:64:e7", "network": {"id": "567865ec-590f-489f-ba94-79b2150230b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-814227769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a4f3f8-69", "ovs_interfaceid": "45a4f3f8-69ee-4cc0-811e-a1178c8b18f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2ff0bc1-8b84-4517-b347-f78bb6a9e14c", "address": "fa:16:3e:6a:a4:65", "network": {"id": "567865ec-590f-489f-ba94-79b2150230b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-814227769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ff0bc1-8b", "ovs_interfaceid": "c2ff0bc1-8b84-4517-b347-f78bb6a9e14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 26 10:39:01.511753 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Start _get_guest_xml network_info=[{"id": "49031ae0-122b-4f20-8d73-20048a6ad965", "address": "fa:16:3e:fd:10:20", "network": {"id": "8142386b-fc69-434d-9373-4536e94d3e62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-385739110-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49031ae0-12", "ovs_interfaceid": "49031ae0-122b-4f20-8d73-20048a6ad965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebb9bc95-98ee-43f1-bd95-8a3da5497c72", "address": "fa:16:3e:17:f5:ed", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb9bc95-98", "ovs_interfaceid": "ebb9bc95-98ee-43f1-bd95-8a3da5497c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dcce8bc4-9171-4ef4-b762-37d89aea863b", "address": "fa:16:3e:ec:35:bf", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcce8bc4-91", "ovs_interfaceid": "dcce8bc4-9171-4ef4-b762-37d89aea863b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9882d815-8273-4eb8-937b-a1c1e4af4018", "address": "fa:16:3e:52:9c:9b", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9882d815-82", "ovs_interfaceid": "9882d815-8273-4eb8-937b-a1c1e4af4018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d782392-1caa-4b0a-b7e2-58c03357a004", "address": "fa:16:3e:ac:bc:0b", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d782392-1c", "ovs_interfaceid": "8d782392-1caa-4b0a-b7e2-58c03357a004", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45a4f3f8-69ee-4cc0-811e-a1178c8b18f2", "address": "fa:16:3e:b3:64:e7", "network": {"id": "567865ec-590f-489f-ba94-79b2150230b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-814227769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a4f3f8-69", "ovs_interfaceid": "45a4f3f8-69ee-4cc0-811e-a1178c8b18f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2ff0bc1-8b84-4517-b347-f78bb6a9e14c", "address": "fa:16:3e:6a:a4:65", "network": {"id": "567865ec-590f-489f-ba94-79b2150230b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-814227769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ff0bc1-8b", "ovs_interfaceid": "c2ff0bc1-8b84-4517-b347-f78bb6a9e14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk', 'boot_index': '2'}, '/dev/vdc': {'bus': 'virtio', 'dev': 'vdc', 'type': 'disk', 'boot_index': '3'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2', 'iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fe657ee-bc44-41d2-b197-f986995424e2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'ee4d14ad-8bd2-4b8b-9526-51abafe757f2', 'attached_at': '', 'detached_at': '', 'volume_id': '0fe657ee-bc44-41d2-b197-f986995424e2', 'serial': '0fe657ee-bc44-41d2-b197-f986995424e2'}, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '39a212f3-1fb9-4c4a-89ba-4c8e8aabb2b6', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', 'iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'ee4d14ad-8bd2-4b8b-9526-51abafe757f2', 'attached_at': '', 'detached_at': '', 'volume_id': '3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', 'serial': '3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4'}, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 1, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': '4de0bd43-66f3-408b-969c-e0f758691e42', 'volume_type': None}, {'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d', 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eab5497d-64ad-45f7-af05-50cde809958d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'ee4d14ad-8bd2-4b8b-9526-51abafe757f2', 'attached_at': '', 'detached_at': '', 'volume_id': 'eab5497d-64ad-45f7-af05-50cde809958d', 'serial': 'eab5497d-64ad-45f7-af05-50cde809958d'}, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': 2, 'disk_bus': 'virtio', 'mount_device': '/dev/vdc', 'attachment_id': '24e6a31f-a274-4d00-9ed1-72391acb528f', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:39:01.517102 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:39:01.518920 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-973724914', uuid='ee4d14ad-8bd2-4b8b-9526-51abafe757f2'), owner=OwnerMeta(userid='ad8d119c32e141afa9b00aa63bcc6770', username='tempest-TaggedBootDevicesTest_v242-2003689595-project-member', projectid='ed3cec81bee74bf3913ab4fcab11a000', projectname='tempest-TaggedBootDevicesTest_v242-2003689595'), image=ImageMeta(id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "49031ae0-122b-4f20-8d73-20048a6ad965", "address": "fa:16:3e:fd:10:20", "network": {"id": "8142386b-fc69-434d-9373-4536e94d3e62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-385739110-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49031ae0-12", "ovs_interfaceid": "49031ae0-122b-4f20-8d73-20048a6ad965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebb9bc95-98ee-43f1-bd95-8a3da5497c72", "address": "fa:16:3e:17:f5:ed", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb9bc95-98", "ovs_interfaceid": "ebb9bc95-98ee-43f1-bd95-8a3da5497c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dcce8bc4-9171-4ef4-b762-37d89aea863b", "address": "fa:16:3e:ec:35:bf", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcce8bc4-91", "ovs_interfaceid": "dcce8bc4-9171-4ef4-b762-37d89aea863b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9882d815-8273-4eb8-937b-a1c1e4af4018", "address": "fa:16:3e:52:9c:9b", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9882d815-82", "ovs_interfaceid": "9882d815-8273-4eb8-937b-a1c1e4af4018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d782392-1caa-4b0a-b7e2-58c03357a004", "address": "fa:16:3e:ac:bc:0b", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d782392-1c", "ovs_interfaceid": "8d782392-1caa-4b0a-b7e2-58c03357a004", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45a4f3f8-69ee-4cc0-811e-a1178c8b18f2", "address": "fa:16:3e:b3:64:e7", "network": {"id": "567865ec-590f-489f-ba94-79b2150230b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-814227769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a4f3f8-69", "ovs_interfaceid": "45a4f3f8-69ee-4cc0-811e-a1178c8b18f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2ff0bc1-8b84-4517-b347-f78bb6a9e14c", "address": "fa:16:3e:6a:a4:65", "network": {"id": "567865ec-590f-489f-ba94-79b2150230b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-814227769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ff0bc1-8b", "ovs_interfaceid": "c2ff0bc1-8b84-4517-b347-f78bb6a9e14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470341.518206) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:39:01.521022 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:39:01.522451 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:39:01.523072 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:39:01.523373 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:39:01.524666 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:39:01.525166 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:39:01.530196 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:39:01.530196 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:39:01.530196 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:39:01.530196 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:39:01.530196 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:39:01.530196 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:39:01.530196 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:39:01.530196 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:39:01.530196 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:39:01.530196 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:39:01.539696 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Calling os-brick to attach iSCSI Volume {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 26 10:39:01.540077 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2', 'iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fe657ee-bc44-41d2-b197-f986995424e2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:39:01.547584 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:01.547584 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:01.547584 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2', 'iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fe657ee-bc44-41d2-b197-f986995424e2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 10:39:01.559320 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:01.559936 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:01.560199 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:39:01.565549 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:01.565966 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:01.567168 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:39:01.575918 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:39:01.575918 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:01.584042 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:39:01.584042 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:01.592461 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2] added Jun 26 10:39:01.592461 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:39:01.592461 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:39:01.592461 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:39:01.592461 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:39:01.592461 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:39:01.592461 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:01.592852 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:39:01.592951 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0327(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:39:01.593157 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:39:01.596548 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2] added Jun 26 10:39:01.596548 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:39:01.596548 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:39:01.596548 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:39:01.596548 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:39:01.596548 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:39:01.596548 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:01.596832 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:39:01.597974 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0307(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:39:01.597974 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:39:01.829487 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:39:01.829487 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] VM Started (Lifecycle Event) Jun 26 10:39:01.883605 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:39:02.331391 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:02.332832 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Paused> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:39:02.332961 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] VM Paused (Lifecycle Event) Jun 26 10:39:02.391075 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.850s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:02.391486 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Start building networks asynchronously for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 26 10:39:02.427970 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:02.562812 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "81a0f65d-2017-4275-aabe-88bc8c81225d" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:02.563275 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:02.593547 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:39:02.597617 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.40.100 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:39:02.613556 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.50.100 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:39:02.622389 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:02.638536 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:02.649153 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:02.649875 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:02.649875 np0000003731 nova-compute[98967]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:39:02.649875 np0000003731 nova-compute[98967]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:39:02.649875 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:02.649875 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:02.650153 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:02.650153 np0000003731 nova-compute[98967]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:39:02.650153 np0000003731 nova-compute[98967]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:39:02.650153 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:02.650153 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:02.673661 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:02.673661 np0000003731 nova-compute[98967]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:39:02.673661 np0000003731 nova-compute[98967]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:39:02.673661 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:02.673661 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:02.673661 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:02.673661 np0000003731 nova-compute[98967]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:39:02.673661 np0000003731 nova-compute[98967]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:39:02.673661 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:02.673661 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:02.704085 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2, portal: 192.168.40.100,3260] Jun 26 10:39:02.704085 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2, portal: 192.168.40.100,3260] successful. Jun 26 10:39:02.704085 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:02.716040 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2, portal: 192.168.50.100,3260] Jun 26 10:39:02.716040 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2, portal: 192.168.50.100,3260] successful. Jun 26 10:39:02.716040 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:02.723404 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:02.740331 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:02.750671 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:02.750671 np0000003731 nova-compute[98967]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:39:02.750671 np0000003731 nova-compute[98967]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:39:02.750671 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:02.750671 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:02.750671 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:02.750671 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:02.750671 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:02.750671 np0000003731 nova-compute[98967]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:39:02.750671 np0000003731 nova-compute[98967]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:39:02.750671 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:02.750671 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:02.750671 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:02.750671 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:02.750671 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.190s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:39:02.750671 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Connected to 192.168.40.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:39:02.751254 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] HCTL ('9', '-', '-', 0) found on session 22 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:39:02.751254 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:39:02.759046 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:02.759046 np0000003731 nova-compute[98967]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:39:02.759046 np0000003731 nova-compute[98967]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:39:02.759046 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:02.759046 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:02.759046 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:02.759046 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:02.760087 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:02.760087 np0000003731 nova-compute[98967]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:39:02.760087 np0000003731 nova-compute[98967]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:39:02.760087 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:02.760087 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:02.760087 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:02.760087 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:02.760087 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.194s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:39:02.760087 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Connected to 192.168.50.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:39:02.766474 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] HCTL ('10', '-', '-', 0) found on session 23 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:39:02.766474 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:39:02.780406 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Searching for a device in session 22 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:39:02.780406 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fe657ee-bc44-41d2-b197-f986995424e2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:39:02.780406 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Searching for a device in session 23 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:39:02.780406 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0fe657ee-bc44-41d2-b197-f986995424e2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:39:02.837133 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:02.838344 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:39:02.896466 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Allocating IP information in the background. {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 26 10:39:02.897929 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] allocate_for_instance() {{(pid=98967) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 26 10:39:02.898253 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:02.898449 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:03.010265 np0000003731 nova-compute[98967]: DEBUG nova.policy [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '3d2ca60f7c4f4cb5a413138ae1f040a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '13f2d75c17e64be5a0a5a2de4aaca2e7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98967) authorize /opt/stack/nova/nova/policy.py:192}} Jun 26 10:39:03.067390 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Detaching volume 686999d0-6896-4156-a01d-0eb60aba41de Jun 26 10:39:03.150143 np0000003731 nova-compute[98967]: INFO nova.virt.block_device [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Attempting to driver detach volume 686999d0-6896-4156-a01d-0eb60aba41de from mountpoint /dev/vdc Jun 26 10:39:03.151460 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-8662162d-3d78-4672-b683-51dc07a2d038 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Snapshot image upload complete Jun 26 10:39:03.152758 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-8662162d-3d78-4672-b683-51dc07a2d038 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 0ae0d213-f58c-4ee5-844f-960b16a5a95b] Took 6.30 seconds to snapshot the instance on the hypervisor. Jun 26 10:39:03.164845 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Found disk vdc by alias ua-686999d0-6896-4156-a01d-0eb60aba41de {{(pid=98967) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 26 10:39:03.169374 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Found disk vdc by alias ua-686999d0-6896-4156-a01d-0eb60aba41de {{(pid=98967) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 26 10:39:03.169374 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Attempting to detach device vdc from instance 81a0f65d-2017-4275-aabe-88bc8c81225d from the persistent domain config. {{(pid=98967) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 26 10:39:03.169374 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] detach device xml: Jun 26 10:39:03.169374 np0000003731 nova-compute[98967]: Jun 26 10:39:03.169374 np0000003731 nova-compute[98967]: Jun 26 10:39:03.169374 np0000003731 nova-compute[98967]: Jun 26 10:39:03.169374 np0000003731 nova-compute[98967]: Jun 26 10:39:03.169374 np0000003731 nova-compute[98967]: 686999d0-6896-4156-a01d-0eb60aba41de Jun 26 10:39:03.169374 np0000003731 nova-compute[98967]:
Jun 26 10:39:03.169374 np0000003731 nova-compute[98967]: Jun 26 10:39:03.169374 np0000003731 nova-compute[98967]: {{(pid=98967) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 26 10:39:03.188386 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Successfully detached device vdc from instance 81a0f65d-2017-4275-aabe-88bc8c81225d from the persistent domain config. Jun 26 10:39:03.188555 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] (1/8): Attempting to detach device vdc with device alias ua-686999d0-6896-4156-a01d-0eb60aba41de from instance 81a0f65d-2017-4275-aabe-88bc8c81225d from the live domain config. {{(pid=98967) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 26 10:39:03.189177 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] detach device xml: Jun 26 10:39:03.189177 np0000003731 nova-compute[98967]: Jun 26 10:39:03.189177 np0000003731 nova-compute[98967]: Jun 26 10:39:03.189177 np0000003731 nova-compute[98967]: Jun 26 10:39:03.189177 np0000003731 nova-compute[98967]: Jun 26 10:39:03.189177 np0000003731 nova-compute[98967]: 686999d0-6896-4156-a01d-0eb60aba41de Jun 26 10:39:03.189177 np0000003731 nova-compute[98967]:
Jun 26 10:39:03.189177 np0000003731 nova-compute[98967]: Jun 26 10:39:03.189177 np0000003731 nova-compute[98967]: {{(pid=98967) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 26 10:39:03.288618 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:03.342515 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] During sync_power_state the instance has a pending task (spawning). Skip. Jun 26 10:39:03.401334 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 26 10:39:03.571493 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 26 10:39:03.815596 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Received event ua-686999d0-6896-4156-a01d-0eb60aba41de> from libvirt while the driver is waiting for it; dispatched. {{(pid=98967) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 26 10:39:03.815596 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Start waiting for the detach event from libvirt for device vdc with device alias ua-686999d0-6896-4156-a01d-0eb60aba41de for instance 81a0f65d-2017-4275-aabe-88bc8c81225d {{(pid=98967) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 26 10:39:03.815596 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Successfully detached device vdc from instance 81a0f65d-2017-4275-aabe-88bc8c81225d from the live domain config. Jun 26 10:39:03.815596 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] calling os-brick to detach iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 26 10:39:03.815596 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de', 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '686999d0-6896-4156-a01d-0eb60aba41de', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, None), 'kwargs': {'force': False}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:39:03.815596 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:03.882264 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Successfully created port: fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:39:03.912733 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Start building block device mappings for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 26 10:39:03.999186 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:04.113083 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._run_pending_deletes {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:39:04.113277 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Cleaning up deleted instances {{(pid=98967) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12085}} Jun 26 10:39:04.580876 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Found WWN 3300000009bb79ee9 for multipath device dm-3 {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 26 10:39:04.580876 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.040s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:39:04.580876 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] <== connect_volume: return (3039ms) {'type': 'block', 'scsi_wwn': '3300000009bb79ee9', 'path': '/dev/dm-3', 'multipath_id': '3300000009bb79ee9'} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:39:04.580876 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000009bb79ee9', 'path': '/dev/dm-3', 'multipath_id': '3300000009bb79ee9'} {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 26 10:39:04.581313 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.766s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:04.581655 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de', 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '686999d0-6896-4156-a01d-0eb60aba41de', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-8'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 10:39:04.581788 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de', 0)] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 10:39:04.610628 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:04.610628 np0000003731 nova-compute[98967]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:39:04.610628 np0000003731 nova-compute[98967]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:39:04.610628 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:04.610628 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:04.610628 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:04.610628 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:04.610628 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:04.610628 np0000003731 nova-compute[98967]: tcp: [20] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:39:04.610628 np0000003731 nova-compute[98967]: tcp: [21] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de (non-flash) Jun 26 10:39:04.610628 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:04.610628 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:04.610628 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:04.610628 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:04.610628 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '2'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de', '20'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de', '21'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2', '23'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '3')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 10:39:04.610628 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de', '20')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:39:04.611854 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de', '21')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:39:04.620264 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Resulting device map defaultdict(. at 0x75f094044cc0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de'): ({'sdj'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de'): ({'sdk'}, set())}) {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 10:39:04.620264 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Removing multipathed devices sdj, sdk {{(pid=98967) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 10:39:04.620264 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Flush multipath device 330000000cb08bae0 {{(pid=98967) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 26 10:39:04.620264 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] There are 0 instances to clean {{(pid=98967) _run_pending_deletes /opt/stack/nova/nova/compute/manager.py:12094}} Jun 26 10:39:04.620264 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._cleanup_incomplete_migrations {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:39:04.620264 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Cleaning up deleted instances with incomplete migration {{(pid=98967) _cleanup_incomplete_migrations /opt/stack/nova/nova/compute/manager.py:12123}} Jun 26 10:39:04.661688 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Remove SCSI device /dev/sdj with /sys/block/sdj/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:39:04.712993 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Remove SCSI device /dev/sdk with /sys/block/sdk/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:39:04.757445 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Checking to see if SCSI volumes sdj, sdk have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 10:39:04.757627 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] SCSI volumes sdj, sdk have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 10:39:04.759361 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Checking to see if device paths {'sdj', 'sdk'} are still under multipathd monitoring {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 10:39:04.771190 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Device paths {'sdj', 'sdk'} have been removed from multipathd monitoring. {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 10:39:04.771721 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de')] {{(pid=98967) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 10:39:04.781922 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:04.811302 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 20, target: iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de, portal: 192.168.40.100,3260] Jun 26 10:39:04.811302 np0000003731 nova-compute[98967]: Logout of [sid: 20, target: iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de, portal: 192.168.40.100,3260] successful. Jun 26 10:39:04.811302 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:04.825265 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:04.836732 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:04.844354 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Successfully updated port: fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:39:04.865298 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 21, target: iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de, portal: 192.168.50.100,3260] Jun 26 10:39:04.865298 np0000003731 nova-compute[98967]: Logout of [sid: 21, target: iqn.2023-03.storpool.com:os--volume-686999d0-6896-4156-a01d-0eb60aba41de, portal: 192.168.50.100,3260] successful. Jun 26 10:39:04.865298 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:04.880308 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:04.881094 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.299s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:39:04.881094 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] <== disconnect_volume: return (1064ms) None {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:39:04.881094 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Disconnected iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 26 10:39:04.910162 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-be6b07da-0d54-48b4-8926-7947f5f2dac2 req-9d4989f1-60d3-4818-a7c0-4570257a284e service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Received event network-changed-fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:04.910162 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-be6b07da-0d54-48b4-8926-7947f5f2dac2 req-9d4989f1-60d3-4818-a7c0-4570257a284e service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Refreshing instance network info cache due to event network-changed-fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:39:04.910162 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-be6b07da-0d54-48b4-8926-7947f5f2dac2 req-9d4989f1-60d3-4818-a7c0-4570257a284e service nova] Acquiring lock "refresh_cache-3a56a898-691e-473e-a5c1-d618e861087b" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:39:04.910162 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-be6b07da-0d54-48b4-8926-7947f5f2dac2 req-9d4989f1-60d3-4818-a7c0-4570257a284e service nova] Acquired lock "refresh_cache-3a56a898-691e-473e-a5c1-d618e861087b" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:39:04.910162 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-be6b07da-0d54-48b4-8926-7947f5f2dac2 req-9d4989f1-60d3-4818-a7c0-4570257a284e service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Refreshing network info cache for port fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:39:04.913792 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Start spawning the instance on the hypervisor. {{(pid=98967) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 26 10:39:04.914670 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Creating instance directory {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 26 10:39:04.914923 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Creating image(s) Jun 26 10:39:04.915366 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:04.915518 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "/opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:04.915962 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "/opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:04.916963 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:39:04.924749 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:39:04.932564 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:05.008957 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.081s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:05.009400 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquiring lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:05.009841 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:05.010262 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:39:05.013715 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:39:05.014219 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:05.086241 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Calling os-brick to attach iSCSI Volume {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 26 10:39:05.087457 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', 'iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:39:05.087457 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:05.089382 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:05.089382 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', 'iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 10:39:05.104060 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:05.104542 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:05.104791 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:39:05.105528 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:05.106148 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:05.106334 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:39:05.117979 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:39:05.117979 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:05.118792 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.105s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:05.119087 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:39:05.119087 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:05.119542 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk 1073741824 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:05.121150 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._cleanup_expired_console_auth_tokens {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:39:05.141458 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4] added Jun 26 10:39:05.141458 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:39:05.141458 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:39:05.141458 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:39:05.141458 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:39:05.141458 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:39:05.141458 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:05.141458 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:39:05.141642 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0366(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:39:05.141922 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:39:05.145216 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4] added Jun 26 10:39:05.145216 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:39:05.145216 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:39:05.145216 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:39:05.145216 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:39:05.145216 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:39:05.145216 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:05.145478 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:39:05.145824 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0393(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:39:05.146066 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:39:05.174197 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk 1073741824" returned: 0 in 0.054s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:05.175367 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.165s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:05.176440 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:05.278268 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.102s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:05.278690 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk. size=1073741824 {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 26 10:39:05.278996 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:05.351400 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquiring lock "refresh_cache-3a56a898-691e-473e-a5c1-d618e861087b" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:39:05.355552 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk --force-share --output=json" returned: 0 in 0.076s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:05.356387 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Cannot resize image /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk to a smaller size. {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 26 10:39:05.356769 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Created local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 26 10:39:05.356954 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Ensure instance console log exists: /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/console.log {{(pid=98967) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 26 10:39:05.357240 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:05.357428 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:05.357598 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:05.412158 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-be6b07da-0d54-48b4-8926-7947f5f2dac2 req-9d4989f1-60d3-4818-a7c0-4570257a284e service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:05.456367 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lazy-loading 'flavor' on Instance uuid 81a0f65d-2017-4275-aabe-88bc8c81225d {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:05.492473 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-be6b07da-0d54-48b4-8926-7947f5f2dac2 req-9d4989f1-60d3-4818-a7c0-4570257a284e service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:39:05.636436 np0000003731 nova-compute[98967]: DEBUG oslo.service.backend._threading.loopingcall [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 2.00 seconds {{(pid=98967) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 26 10:39:05.661986 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-be6b07da-0d54-48b4-8926-7947f5f2dac2 req-9d4989f1-60d3-4818-a7c0-4570257a284e service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:39:05.667554 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:05.667803 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:06.136535 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:06.142259 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:39:06.146490 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.40.100 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:39:06.154171 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.50.100 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:39:06.160076 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:06.168470 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:06.170349 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Starting instance... {{(pid=98967) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 26 10:39:06.173103 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-be6b07da-0d54-48b4-8926-7947f5f2dac2 req-9d4989f1-60d3-4818-a7c0-4570257a284e service nova] Releasing lock "refresh_cache-3a56a898-691e-473e-a5c1-d618e861087b" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:39:06.174876 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:06.176904 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquired lock "refresh_cache-3a56a898-691e-473e-a5c1-d618e861087b" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:39:06.177287 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:39:06.184453 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:06.184453 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:06.184453 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:06.184453 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:06.184453 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:06.184453 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:06.184453 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:06.184453 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:06.184453 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:06.184453 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:06.192875 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:06.192875 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:06.192875 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:06.192875 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:06.192875 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:06.193177 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:06.193177 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:06.193177 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:06.193177 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:06.193177 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:06.221733 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4, portal: 192.168.40.100,3260] Jun 26 10:39:06.221733 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4, portal: 192.168.40.100,3260] successful. Jun 26 10:39:06.221733 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:06.237312 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:06.243458 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4, portal: 192.168.50.100,3260] Jun 26 10:39:06.243458 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4, portal: 192.168.50.100,3260] successful. Jun 26 10:39:06.243458 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:06.256512 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:06.257251 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:06.257251 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:06.257251 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:06.257251 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:06.257251 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:06.257251 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:06.257251 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:06.257856 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:06.257856 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:06.257856 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:06.257856 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:06.257856 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:06.257856 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:06.257856 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:06.257856 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.153s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:39:06.258184 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Connected to 192.168.40.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:39:06.258693 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] HCTL ('11', '-', '-', 0) found on session 24 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:39:06.258759 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:39:06.272814 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:06.272814 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:06.272814 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:06.272814 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:06.272814 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:06.272814 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:06.272814 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:06.277122 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:06.277122 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:06.277122 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:06.277122 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:06.277122 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:06.277122 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:06.277122 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:06.277122 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.167s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:39:06.277122 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Connected to 192.168.50.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:39:06.277122 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] HCTL ('12', '-', '-', 0) found on session 25 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:39:06.277122 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:39:06.277833 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Searching for a device in session 24 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:39:06.279317 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:39:06.289034 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Searching for a device in session 25 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:39:06.289226 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:39:06.463210 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-b2e16c32-99df-4601-8703-2bd33e3ed680 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 3.900s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:06.640142 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-ddc0d793-6092-4063-8bf8-8c426066e8bc req-30c386bf-9605-413d-bb4b-4d40a913d236 service nova] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Received event network-vif-plugged-b747180c-b090-4936-90bc-0c6553817170 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:06.640142 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-ddc0d793-6092-4063-8bf8-8c426066e8bc req-30c386bf-9605-413d-bb4b-4d40a913d236 service nova] Acquiring lock "f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:06.640142 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-ddc0d793-6092-4063-8bf8-8c426066e8bc req-30c386bf-9605-413d-bb4b-4d40a913d236 service nova] Lock "f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:06.640142 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-ddc0d793-6092-4063-8bf8-8c426066e8bc req-30c386bf-9605-413d-bb4b-4d40a913d236 service nova] Lock "f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:06.640142 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-ddc0d793-6092-4063-8bf8-8c426066e8bc req-30c386bf-9605-413d-bb4b-4d40a913d236 service nova] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Processing event network-vif-plugged-b747180c-b090-4936-90bc-0c6553817170 {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:39:06.641106 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Instance event wait completed in 4 seconds for network-vif-plugged {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:39:06.646350 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:39:06.646589 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] VM Resumed (Lifecycle Event) Jun 26 10:39:06.653363 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Guest created on hypervisor {{(pid=98967) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 26 10:39:06.658462 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Instance spawned successfully. Jun 26 10:39:06.658855 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 26 10:39:06.768242 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:06.768486 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:06.774140 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98967) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 26 10:39:06.774140 np0000003731 nova-compute[98967]: INFO nova.compute.claims [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Claim successful on node np0000003731 Jun 26 10:39:06.802953 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:39:07.002773 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-1f698fcd-77c1-4841-951e-e7b1703c6fc3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "81a0f65d-2017-4275-aabe-88bc8c81225d" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:07.002923 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-1f698fcd-77c1-4841-951e-e7b1703c6fc3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:07.003248 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-1f698fcd-77c1-4841-951e-e7b1703c6fc3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:07.003408 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-1f698fcd-77c1-4841-951e-e7b1703c6fc3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:07.003553 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-1f698fcd-77c1-4841-951e-e7b1703c6fc3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:07.005661 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-1f698fcd-77c1-4841-951e-e7b1703c6fc3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Terminating instance Jun 26 10:39:07.044987 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:07.109657 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 26 10:39:07.151220 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:07.153539 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:39:07.165592 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Found default for hw_cdrom_bus of ide {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:07.165951 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Found default for hw_disk_bus of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:07.166339 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Found default for hw_input_bus of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:07.166770 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Found default for hw_pointer_model of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:07.167188 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Found default for hw_video_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:07.167441 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Found default for hw_vif_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:07.209774 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Updating instance_info_cache with network_info: [{"id": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "address": "fa:16:3e:9c:69:06", "network": {"id": "745fd3f4-1b5b-4135-add5-62d583152edb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1747333964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13f2d75c17e64be5a0a5a2de4aaca2e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f36cb-f5", "ovs_interfaceid": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:39:07.431845 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:07.508368 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-1f698fcd-77c1-4841-951e-e7b1703c6fc3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Start destroying the instance on the hypervisor. {{(pid=98967) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 26 10:39:07.534097 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:07.538145 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:07.559442 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:07.562946 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:07.586567 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:07.593748 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:07.615832 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:07.636550 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:39:07.636836 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98967) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 26 10:39:07.636963 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager.update_available_resource {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:39:07.658208 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] During sync_power_state the instance has a pending task (spawning). Skip. Jun 26 10:39:07.672578 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Took 14.78 seconds to spawn the instance on the hypervisor. Jun 26 10:39:07.672578 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:07.709651 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Releasing lock "refresh_cache-3a56a898-691e-473e-a5c1-d618e861087b" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:39:07.709651 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Instance network_info: |[{"id": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "address": "fa:16:3e:9c:69:06", "network": {"id": "745fd3f4-1b5b-4135-add5-62d583152edb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1747333964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13f2d75c17e64be5a0a5a2de4aaca2e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f36cb-f5", "ovs_interfaceid": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 26 10:39:07.712777 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Start _get_guest_xml network_info=[{"id": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "address": "fa:16:3e:9c:69:06", "network": {"id": "745fd3f4-1b5b-4135-add5-62d583152edb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1747333964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13f2d75c17e64be5a0a5a2de4aaca2e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f36cb-f5", "ovs_interfaceid": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'image_id': 'a9b18127-6fee-4ed6-b364-a2d634ecb8b7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:39:07.717847 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:39:07.719077 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-189933630', uuid='3a56a898-691e-473e-a5c1-d618e861087b'), owner=OwnerMeta(userid='3d2ca60f7c4f4cb5a413138ae1f040a7', username='tempest-ServerActionsTestOtherB-576427951-project-member', projectid='13f2d75c17e64be5a0a5a2de4aaca2e7', projectname='tempest-ServerActionsTestOtherB-576427951'), image=ImageMeta(id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "address": "fa:16:3e:9c:69:06", "network": {"id": "745fd3f4-1b5b-4135-add5-62d583152edb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1747333964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13f2d75c17e64be5a0a5a2de4aaca2e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f36cb-f5", "ovs_interfaceid": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470347.7187161) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:39:07.728284 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:39:07.728812 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:39:07.730571 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:39:07.730571 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:39:07.732174 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:39:07.732174 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:39:07.732174 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:39:07.732174 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:39:07.732174 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:39:07.732174 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:39:07.732174 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:39:07.732174 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:39:07.732174 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:39:07.732174 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:39:07.733335 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:39:07.733335 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:39:07.747375 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-23185dbd-0942-40e6-af99-2a367e5c785c req-ac85d6fc-95c5-4a3b-ab62-b46293b286fa service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Received event network-vif-unplugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:07.747565 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-23185dbd-0942-40e6-af99-2a367e5c785c req-ac85d6fc-95c5-4a3b-ab62-b46293b286fa service nova] Acquiring lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:07.747734 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-23185dbd-0942-40e6-af99-2a367e5c785c req-ac85d6fc-95c5-4a3b-ab62-b46293b286fa service nova] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:07.747868 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-23185dbd-0942-40e6-af99-2a367e5c785c req-ac85d6fc-95c5-4a3b-ab62-b46293b286fa service nova] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:07.748324 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-23185dbd-0942-40e6-af99-2a367e5c785c req-ac85d6fc-95c5-4a3b-ab62-b46293b286fa service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] No waiting events found dispatching network-vif-unplugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:39:07.748496 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-23185dbd-0942-40e6-af99-2a367e5c785c req-ac85d6fc-95c5-4a3b-ab62-b46293b286fa service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Received event network-vif-unplugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:39:07.749192 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:38:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-189933630',display_name='tempest-ServerActionsTestOtherB-server-189933630',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-serveractionstestotherb-server-189933630',id=19,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDv+GLIZEgqCpG9Ar7Sy1trgWnL3YEyqFHnBU/WG9g4CSqyvLBbCulNghiyJn3KpB/3bSNsGv+SgxNXmmFNVCZyLb+bs7KEXcLVodWAftMPleXJm0MjBQWdyVYaPKr8FFQ==',key_name='tempest-keypair-1436363432',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13f2d75c17e64be5a0a5a2de4aaca2e7',ramdisk_id='',reservation_id='r-y898iga0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-576427951',owner_user_name='tempest-ServerActionsTestOtherB-576427951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:39:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d2ca60f7c4f4cb5a413138ae1f040a7',uuid=3a56a898-691e-473e-a5c1-d618e861087b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "address": "fa:16:3e:9c:69:06", "network": {"id": "745fd3f4-1b5b-4135-add5-62d583152edb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1747333964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13f2d75c17e64be5a0a5a2de4aaca2e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f36cb-f5", "ovs_interfaceid": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:39:07.749347 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Converting VIF {"id": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "address": "fa:16:3e:9c:69:06", "network": {"id": "745fd3f4-1b5b-4135-add5-62d583152edb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1747333964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13f2d75c17e64be5a0a5a2de4aaca2e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f36cb-f5", "ovs_interfaceid": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:39:07.749948 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:69:06,bridge_name='br-int',has_traffic_filtering=True,id=fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df,network=Network(745fd3f4-1b5b-4135-add5-62d583152edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd2f36cb-f5') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:39:07.750547 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lazy-loading 'pci_devices' on Instance uuid 3a56a898-691e-473e-a5c1-d618e861087b {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:07.854937 np0000003731 nova-compute[98967]: DEBUG nova.utils [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Queued Task(fn=>, remaining_delay=14.999625766999998 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:39:07.859749 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.994705306000014 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:39:07.860068 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.99446670400016 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:39:07.864550 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Instance destroyed successfully. Jun 26 10:39:07.864988 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-1f698fcd-77c1-4841-951e-e7b1703c6fc3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lazy-loading 'resources' on Instance uuid 81a0f65d-2017-4275-aabe-88bc8c81225d {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:08.129790 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Found WWN 330000000ee608f42 for multipath device dm-6 {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 26 10:39:08.132517 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.042s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:39:08.132725 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] <== connect_volume: return (3045ms) {'type': 'block', 'scsi_wwn': '330000000ee608f42', 'path': '/dev/dm-6', 'multipath_id': '330000000ee608f42'} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:39:08.132910 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000ee608f42', 'path': '/dev/dm-6', 'multipath_id': '330000000ee608f42'} {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 26 10:39:08.147366 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:08.189363 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Took 20.70 seconds to build instance. Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] End _get_guest_xml xml= Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: 3a56a898-691e-473e-a5c1-d618e861087b Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: instance-00000013 Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: 196608 Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: tempest-ServerActionsTestOtherB-server-189933630 Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: 2026-06-26 10:39:07 Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: 192 Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: 0 Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: 0 Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: True Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: bare Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: 0 Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: virtio Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: tempest-ServerActionsTestOtherB-576427951-project-member Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: tempest-ServerActionsTestOtherB-576427951 Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: 3a56a898-691e-473e-a5c1-d618e861087b Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: 3a56a898-691e-473e-a5c1-d618e861087b Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: hvm Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: 128 Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: Jun 26 10:39:08.255243 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:39:08.259922 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Preparing to wait for external event network-vif-plugged-fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:39:08.259922 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquiring lock "3a56a898-691e-473e-a5c1-d618e861087b-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:08.259922 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "3a56a898-691e-473e-a5c1-d618e861087b-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:08.259922 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "3a56a898-691e-473e-a5c1-d618e861087b-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:08.259922 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:38:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-189933630',display_name='tempest-ServerActionsTestOtherB-server-189933630',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-serveractionstestotherb-server-189933630',id=19,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDv+GLIZEgqCpG9Ar7Sy1trgWnL3YEyqFHnBU/WG9g4CSqyvLBbCulNghiyJn3KpB/3bSNsGv+SgxNXmmFNVCZyLb+bs7KEXcLVodWAftMPleXJm0MjBQWdyVYaPKr8FFQ==',key_name='tempest-keypair-1436363432',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='13f2d75c17e64be5a0a5a2de4aaca2e7',ramdisk_id='',reservation_id='r-y898iga0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsTestOtherB-576427951',owner_user_name='tempest-ServerActionsTestOtherB-576427951-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:39:04Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d2ca60f7c4f4cb5a413138ae1f040a7',uuid=3a56a898-691e-473e-a5c1-d618e861087b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "address": "fa:16:3e:9c:69:06", "network": {"id": "745fd3f4-1b5b-4135-add5-62d583152edb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1747333964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13f2d75c17e64be5a0a5a2de4aaca2e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f36cb-f5", "ovs_interfaceid": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:39:08.259922 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Converting VIF {"id": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "address": "fa:16:3e:9c:69:06", "network": {"id": "745fd3f4-1b5b-4135-add5-62d583152edb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1747333964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13f2d75c17e64be5a0a5a2de4aaca2e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f36cb-f5", "ovs_interfaceid": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:39:08.259922 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:69:06,bridge_name='br-int',has_traffic_filtering=True,id=fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df,network=Network(745fd3f4-1b5b-4135-add5-62d583152edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd2f36cb-f5') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:39:08.259922 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:69:06,bridge_name='br-int',has_traffic_filtering=True,id=fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df,network=Network(745fd3f4-1b5b-4135-add5-62d583152edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd2f36cb-f5') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:39:08.259922 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:08.259922 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:08.261058 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:39:08.261150 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:08.261337 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c30be4f5-3492-5eed-a78c-3a6724cfe3b8', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:08.263934 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:08.264766 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:39:08.271545 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:08.275855 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:08.276063 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd2f36cb-f5, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:08.276384 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd2f36cb-f5, col_values=(('qos', UUID('4bb4243e-5d6a-4e73-9b37-05feee3a99cc')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:08.276581 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd2f36cb-f5, col_values=(('external_ids', {'iface-id': 'fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:69:06', 'vm-uuid': '3a56a898-691e-473e-a5c1-d618e861087b'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:08.277537 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:08.278599 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:39:08.290314 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:08.291475 np0000003731 nova-compute[98967]: INFO os_vif [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:69:06,bridge_name='br-int',has_traffic_filtering=True,id=fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df,network=Network(745fd3f4-1b5b-4135-add5-62d583152edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd2f36cb-f5') Jun 26 10:39:08.368681 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-1f698fcd-77c1-4841-951e-e7b1703c6fc3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-26T10:36:38Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-674212499',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-attachvolumeshelvetestjson-server-674212499',id=2,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIgeE4mXMKcSbJIWHFgR/TXryRGqygdB9I0LofQr9Tkzp2atTItlVxi0dphSY3RtGlhO4PbYXX3eB89/U6r4md80N0ifQ7kIfDklEzYBE4Yx9SRGtqxnbv5XSO42PKS1ng==',key_name='tempest-keypair-313994434',keypairs=,launch_index=0,launched_at=2026-06-26T10:38:24Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='39600b204ad64a6db28676693c86dd70',ramdisk_id='',reservation_id='r-691lr44p',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-959960600',owner_user_name='tempest-AttachVolumeShelveTestJSON-959960600-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-26T10:38:24Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a7c139c060e4c998d31cf957835db61',uuid=81a0f65d-2017-4275-aabe-88bc8c81225d,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "address": "fa:16:3e:4c:ec:5e", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ae095e-5d", "ovs_interfaceid": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 26 10:39:08.368855 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-1f698fcd-77c1-4841-951e-e7b1703c6fc3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Converting VIF {"id": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "address": "fa:16:3e:4c:ec:5e", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.10", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.84", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb6ae095e-5d", "ovs_interfaceid": "b6ae095e-5da6-45dd-95bd-47cf007120c3", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:39:08.369433 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-1f698fcd-77c1-4841-951e-e7b1703c6fc3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:4c:ec:5e,bridge_name='br-int',has_traffic_filtering=True,id=b6ae095e-5da6-45dd-95bd-47cf007120c3,network=Network(79bcd519-98c3-4905-a83f-c080654f2cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6ae095e-5d') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:39:08.370481 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-1f698fcd-77c1-4841-951e-e7b1703c6fc3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:ec:5e,bridge_name='br-int',has_traffic_filtering=True,id=b6ae095e-5da6-45dd-95bd-47cf007120c3,network=Network(79bcd519-98c3-4905-a83f-c080654f2cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6ae095e-5d') {{(pid=98967) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 26 10:39:08.371684 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:08.371954 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb6ae095e-5d, bridge=br-int, if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:08.372882 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:08.373605 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:39:08.383973 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:08.384847 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:08.385117 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ea233dfb-b5e3-46fd-a848-156a2ba34d41) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:08.385671 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:08.386128 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:39:08.391632 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:08.393796 np0000003731 nova-compute[98967]: INFO os_vif [None req-1f698fcd-77c1-4841-951e-e7b1703c6fc3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:4c:ec:5e,bridge_name='br-int',has_traffic_filtering=True,id=b6ae095e-5da6-45dd-95bd-47cf007120c3,network=Network(79bcd519-98c3-4905-a83f-c080654f2cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb6ae095e-5d') Jun 26 10:39:08.394075 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-1f698fcd-77c1-4841-951e-e7b1703c6fc3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Deleting instance files /opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d_del Jun 26 10:39:08.403340 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-1f698fcd-77c1-4841-951e-e7b1703c6fc3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Deletion of /opt/stack/data/nova/instances/81a0f65d-2017-4275-aabe-88bc8c81225d_del complete Jun 26 10:39:08.546823 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:39:08.547322 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:39:08.646860 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Calling os-brick to attach iSCSI Volume {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 26 10:39:08.646860 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d', 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eab5497d-64ad-45f7-af05-50cde809958d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:39:08.647674 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:08.647674 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:08.647674 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d', 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eab5497d-64ad-45f7-af05-50cde809958d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 10:39:08.663441 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:08.663441 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:08.663441 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:08.663441 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:39:08.668465 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:08.668465 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:39:08.677119 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:39:08.677119 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:08.685814 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:39:08.685814 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:08.691702 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-4b0e42cc-7013-49b2-a06b-4c7aaa354484 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 22.207s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:08.693709 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d] added Jun 26 10:39:08.693709 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:39:08.693709 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:39:08.693709 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:39:08.693709 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:39:08.693709 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:39:08.693709 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:08.693961 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:39:08.693961 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0295(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:39:08.694172 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:39:08.697432 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d] added Jun 26 10:39:08.697432 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:39:08.697432 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:39:08.697432 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:39:08.697432 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:39:08.697432 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:39:08.697432 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:08.697686 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:39:08.697840 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.035(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:39:08.697992 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:39:08.760973 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-700a9a49-fe84-4b9a-bd3b-467242ff88ed req-bf67e20b-9c39-4671-bec0-27f8e2c07e70 service nova] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Received event network-vif-plugged-b747180c-b090-4936-90bc-0c6553817170 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:08.760973 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-700a9a49-fe84-4b9a-bd3b-467242ff88ed req-bf67e20b-9c39-4671-bec0-27f8e2c07e70 service nova] Acquiring lock "f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:08.760973 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-700a9a49-fe84-4b9a-bd3b-467242ff88ed req-bf67e20b-9c39-4671-bec0-27f8e2c07e70 service nova] Lock "f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:08.761591 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-700a9a49-fe84-4b9a-bd3b-467242ff88ed req-bf67e20b-9c39-4671-bec0-27f8e2c07e70 service nova] Lock "f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:08.761591 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-700a9a49-fe84-4b9a-bd3b-467242ff88ed req-bf67e20b-9c39-4671-bec0-27f8e2c07e70 service nova] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] No waiting events found dispatching network-vif-plugged-b747180c-b090-4936-90bc-0c6553817170 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:39:08.765326 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-700a9a49-fe84-4b9a-bd3b-467242ff88ed req-bf67e20b-9c39-4671-bec0-27f8e2c07e70 service nova] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Received unexpected event network-vif-plugged-b747180c-b090-4936-90bc-0c6553817170 for instance with vm_state active and task_state None. Jun 26 10:39:08.765497 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:08.911514 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-1f698fcd-77c1-4841-951e-e7b1703c6fc3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Took 1.40 seconds to destroy the instance on the hypervisor. Jun 26 10:39:08.912843 np0000003731 nova-compute[98967]: DEBUG oslo.service.backend._common.loopingcall [None req-1f698fcd-77c1-4841-951e-e7b1703c6fc3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98967) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 26 10:39:08.913186 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [-] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Deallocating network for instance {{(pid=98967) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 26 10:39:08.913186 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [-] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] deallocate_for_instance() {{(pid=98967) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 26 10:39:08.914106 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:09.019659 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:09.051197 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:39:09.562339 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.794s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:09.562802 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Start building networks asynchronously for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 26 10:39:09.566549 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 1.420s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:09.567284 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:09.567284 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Auditing locally available compute resources for np0000003731 (node: np0000003731) {{(pid=98967) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 26 10:39:09.694716 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:39:09.698320 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.50.100 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:39:09.714992 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.40.100 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:39:09.723305 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:09.733743 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:09.744217 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:09.753079 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:09.753079 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:09.753079 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:09.753079 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:09.753079 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:09.753079 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:09.753079 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:09.753782 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:09.753782 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:09.753782 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:09.753782 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:09.753782 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:09.753782 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:09.753782 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:09.765044 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:09.765044 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:09.765044 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:09.765044 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:09.765044 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:09.765044 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:09.765044 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:09.765044 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:09.765044 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:09.765044 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:09.765044 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:09.765044 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:09.765044 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:09.765044 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:09.785460 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b2eb04a2-3b22-4de0-b57f-88eaf47f8a3b req-51c40bec-b317-4a28-b911-eda93fb4edb1 service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Received event network-vif-deleted-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:09.785681 np0000003731 nova-compute[98967]: INFO nova.compute.manager [req-b2eb04a2-3b22-4de0-b57f-88eaf47f8a3b req-51c40bec-b317-4a28-b911-eda93fb4edb1 service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Neutron deleted interface b6ae095e-5da6-45dd-95bd-47cf007120c3; detaching it from the instance and deleting it from the info cache Jun 26 10:39:09.788944 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b2eb04a2-3b22-4de0-b57f-88eaf47f8a3b req-51c40bec-b317-4a28-b911-eda93fb4edb1 service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Detach interface failed, port_id=b6ae095e-5da6-45dd-95bd-47cf007120c3, reason: Instance 81a0f65d-2017-4275-aabe-88bc8c81225d could not be found. {{(pid=98967) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 26 10:39:09.814544 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d, portal: 192.168.50.100,3260] Jun 26 10:39:09.814544 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d, portal: 192.168.50.100,3260] successful. Jun 26 10:39:09.814544 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:09.817805 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:39:09.818028 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:39:09.818703 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] No VIF found with MAC fa:16:3e:9c:69:06, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:39:09.819231 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Using config drive Jun 26 10:39:09.831407 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:09.836722 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d, portal: 192.168.40.100,3260] Jun 26 10:39:09.836722 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d, portal: 192.168.40.100,3260] successful. Jun 26 10:39:09.836722 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:09.851694 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-cc2604e8-c2d2-46a0-a486-f5c1bab3661a req-6f1e3f7f-e664-4653-b6b9-dd83b2d8be2b service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Received event network-vif-unplugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:09.852022 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-cc2604e8-c2d2-46a0-a486-f5c1bab3661a req-6f1e3f7f-e664-4653-b6b9-dd83b2d8be2b service nova] Acquiring lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:09.852022 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-cc2604e8-c2d2-46a0-a486-f5c1bab3661a req-6f1e3f7f-e664-4653-b6b9-dd83b2d8be2b service nova] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:09.853385 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-cc2604e8-c2d2-46a0-a486-f5c1bab3661a req-6f1e3f7f-e664-4653-b6b9-dd83b2d8be2b service nova] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:09.853940 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-cc2604e8-c2d2-46a0-a486-f5c1bab3661a req-6f1e3f7f-e664-4653-b6b9-dd83b2d8be2b service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] No waiting events found dispatching network-vif-unplugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:39:09.855146 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:09.856334 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:09.856334 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:09.856334 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:09.856334 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:09.856334 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:09.856334 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:09.856334 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:09.856334 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:09.856334 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:09.856334 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:09.856334 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:09.856334 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:09.856334 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:09.856334 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:09.856334 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:09.856334 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:09.856334 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:09.856334 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:09.856334 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.192s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:39:09.856334 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Connected to 192.168.50.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:39:09.858402 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-cc2604e8-c2d2-46a0-a486-f5c1bab3661a req-6f1e3f7f-e664-4653-b6b9-dd83b2d8be2b service nova] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Received event network-vif-unplugged-b6ae095e-5da6-45dd-95bd-47cf007120c3 for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:39:09.859775 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] HCTL ('13', '-', '-', 0) found on session 26 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:39:09.860082 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:39:09.874234 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:09.874234 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:09.874234 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:09.874234 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:09.874234 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:09.874234 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:09.874234 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:09.874234 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:09.874234 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:09.874471 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:09.874471 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:09.874471 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:09.874471 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:09.874471 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:09.874471 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:09.874471 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:09.874471 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:09.874471 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:09.874714 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.212s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:39:09.874906 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Connected to 192.168.40.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:39:09.876268 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] HCTL ('14', '-', '-', 0) found on session 27 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:39:09.876370 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:39:09.929353 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Searching for a device in session 26 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:39:09.929353 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'eab5497d-64ad-45f7-af05-50cde809958d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:39:09.930875 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Searching for a device in session 27 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:39:09.930875 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eab5497d-64ad-45f7-af05-50cde809958d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:39:10.008636 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:10.069080 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Allocating IP information in the background. {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 26 10:39:10.069264 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] allocate_for_instance() {{(pid=98967) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 26 10:39:10.070299 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:10.070299 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:10.213650 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [-] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:39:10.243061 np0000003731 nova-compute[98967]: DEBUG nova.policy [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72704c563abb412aa2c238092bd55ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea834a26efe148649425d3e02d974ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98967) authorize /opt/stack/nova/nova/policy.py:192}} Jun 26 10:39:10.327340 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:10.525909 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Creating config drive at /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk.config Jun 26 10:39:10.531158 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6b3wgr74 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:10.576905 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 26 10:39:10.597571 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp6b3wgr74" returned: 0 in 0.066s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:10.638108 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98967) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 26 10:39:10.640617 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:10.666763 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 26 10:39:10.717521 np0000003731 nova-compute[98967]: INFO nova.compute.manager [-] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Took 1.80 seconds to deallocate network for instance. Jun 26 10:39:10.769995 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474/disk --force-share --output=json" returned: 0 in 0.129s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:10.772065 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:10.822815 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Successfully created port: 43cc3477-2288-4c03-8374-5701e3d3baa1 {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:39:10.878713 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-095295f3-8742-4092-9a9b-3ba6ba1ae38a req-8a1a0855-4e19-482c-a108-d86f1759fb97 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Received event network-changed-061a7108-6f47-4def-b12d-38eb13d382f6 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:10.878933 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-095295f3-8742-4092-9a9b-3ba6ba1ae38a req-8a1a0855-4e19-482c-a108-d86f1759fb97 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Refreshing instance network info cache due to event network-changed-061a7108-6f47-4def-b12d-38eb13d382f6. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:39:10.879839 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-095295f3-8742-4092-9a9b-3ba6ba1ae38a req-8a1a0855-4e19-482c-a108-d86f1759fb97 service nova] Acquiring lock "refresh_cache-c1043abd-b0c0-439e-b065-8bef627483cb" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:39:10.879839 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-095295f3-8742-4092-9a9b-3ba6ba1ae38a req-8a1a0855-4e19-482c-a108-d86f1759fb97 service nova] Acquired lock "refresh_cache-c1043abd-b0c0-439e-b065-8bef627483cb" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:39:10.883234 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-095295f3-8742-4092-9a9b-3ba6ba1ae38a req-8a1a0855-4e19-482c-a108-d86f1759fb97 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Refreshing network info cache for port 061a7108-6f47-4def-b12d-38eb13d382f6 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:39:10.885104 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:10.890110 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk.rescue --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:10.991480 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk.rescue --force-share --output=json" returned: 0 in 0.101s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:10.992717 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk.rescue --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:11.087481 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Start building block device mappings for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 26 10:39:11.099792 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk.rescue --force-share --output=json" returned: 0 in 0.107s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:11.100555 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:11.165357 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:11.195218 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk --force-share --output=json" returned: 0 in 0.094s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:11.196468 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:11.216807 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:11.234401 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-1f698fcd-77c1-4841-951e-e7b1703c6fc3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:11.234401 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-1f698fcd-77c1-4841-951e-e7b1703c6fc3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:11.300544 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:11.313229 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk --force-share --output=json" returned: 0 in 0.117s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:11.319557 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:11.388586 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-095295f3-8742-4092-9a9b-3ba6ba1ae38a req-8a1a0855-4e19-482c-a108-d86f1759fb97 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:11.432881 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:11.437237 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:11.496640 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "c1043abd-b0c0-439e-b065-8bef627483cb" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:11.496957 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "c1043abd-b0c0-439e-b065-8bef627483cb" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:11.535252 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk --force-share --output=json" returned: 0 in 0.099s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:11.542123 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:11.592256 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Successfully updated port: 43cc3477-2288-4c03-8374-5701e3d3baa1 {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:39:11.596894 np0000003731 nova-compute[98967]: INFO nova.virt.block_device [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Booting with blank volume at /dev/vda Jun 26 10:39:11.605376 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:11.608549 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:11.639832 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:11.647684 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:11.649591 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:11.696651 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Found WWN 330000000e189e75e for multipath device dm-7 {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 26 10:39:11.697561 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.050s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:39:11.697814 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] <== connect_volume: return (3051ms) {'type': 'block', 'scsi_wwn': '330000000e189e75e', 'path': '/dev/dm-7', 'multipath_id': '330000000e189e75e'} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:39:11.698071 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e189e75e', 'path': '/dev/dm-7', 'multipath_id': '330000000e189e75e'} {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 26 10:39:11.708896 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-1883ed01-63d3-48f9-a64e-c7da1be5f602 req-629bafba-de2c-44ba-bdc2-9b9d5ced8b4f service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Received event network-changed-43cc3477-2288-4c03-8374-5701e3d3baa1 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:11.710945 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-1883ed01-63d3-48f9-a64e-c7da1be5f602 req-629bafba-de2c-44ba-bdc2-9b9d5ced8b4f service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Refreshing instance network info cache due to event network-changed-43cc3477-2288-4c03-8374-5701e3d3baa1. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:39:11.712684 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-1883ed01-63d3-48f9-a64e-c7da1be5f602 req-629bafba-de2c-44ba-bdc2-9b9d5ced8b4f service nova] Acquiring lock "refresh_cache-b53c3532-08c2-4c05-b5e5-c217d3ef4d9a" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:39:11.728262 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-1883ed01-63d3-48f9-a64e-c7da1be5f602 req-629bafba-de2c-44ba-bdc2-9b9d5ced8b4f service nova] Acquired lock "refresh_cache-b53c3532-08c2-4c05-b5e5-c217d3ef4d9a" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:39:11.729346 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-1883ed01-63d3-48f9-a64e-c7da1be5f602 req-629bafba-de2c-44ba-bdc2-9b9d5ced8b4f service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Refreshing network info cache for port 43cc3477-2288-4c03-8374-5701e3d3baa1 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:39:11.804833 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/disk --force-share --output=json" returned: 0 in 0.155s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:11.811353 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ae0d213-f58c-4ee5-844f-960b16a5a95b/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:11.930924 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ae0d213-f58c-4ee5-844f-960b16a5a95b/disk --force-share --output=json" returned: 0 in 0.120s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:11.932262 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ae0d213-f58c-4ee5-844f-960b16a5a95b/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:12.002623 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lazy-loading 'flavor' on Instance uuid c1043abd-b0c0-439e-b065-8bef627483cb {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:12.025494 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ae0d213-f58c-4ee5-844f-960b16a5a95b/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:12.036370 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212147b0-26de-42cd-b43d-057ec8d61c72/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:12.066427 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-095295f3-8742-4092-9a9b-3ba6ba1ae38a req-8a1a0855-4e19-482c-a108-d86f1759fb97 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:12.102123 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "refresh_cache-b53c3532-08c2-4c05-b5e5-c217d3ef4d9a" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:39:12.154768 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212147b0-26de-42cd-b43d-057ec8d61c72/disk --force-share --output=json" returned: 0 in 0.118s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:12.154768 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212147b0-26de-42cd-b43d-057ec8d61c72/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:12.232112 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-973724914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-973724914',id=15,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXXNelE8aiksVglbu5IxieekgunImq0N8+gB4i90SwlKOgJ5jLGESQZW447OC9RX/nj6CZ9Xqc+BXv17PDZZ0k5ralnrDScL3N6RSoxQIMTo0XHVyGosZZTWsRkqiRsVA==',key_name='tempest-keypair-933133359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed3cec81bee74bf3913ab4fcab11a000',ramdisk_id='',reservation_id='r-u7cn8k51',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2003689595',owner_user_name='tempest-TaggedBootDevicesTest_v242-2003689595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:38:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad8d119c32e141afa9b00aa63bcc6770',uuid=ee4d14ad-8bd2-4b8b-9526-51abafe757f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49031ae0-122b-4f20-8d73-20048a6ad965", "address": "fa:16:3e:fd:10:20", "network": {"id": "8142386b-fc69-434d-9373-4536e94d3e62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-385739110-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49031ae0-12", "ovs_interfaceid": "49031ae0-122b-4f20-8d73-20048a6ad965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:39:12.232851 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converting VIF {"id": "49031ae0-122b-4f20-8d73-20048a6ad965", "address": "fa:16:3e:fd:10:20", "network": {"id": "8142386b-fc69-434d-9373-4536e94d3e62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-385739110-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49031ae0-12", "ovs_interfaceid": "49031ae0-122b-4f20-8d73-20048a6ad965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:39:12.233893 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:10:20,bridge_name='br-int',has_traffic_filtering=True,id=49031ae0-122b-4f20-8d73-20048a6ad965,network=Network(8142386b-fc69-434d-9373-4536e94d3e62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49031ae0-12') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:39:12.235647 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-973724914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-973724914',id=15,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXXNelE8aiksVglbu5IxieekgunImq0N8+gB4i90SwlKOgJ5jLGESQZW447OC9RX/nj6CZ9Xqc+BXv17PDZZ0k5ralnrDScL3N6RSoxQIMTo0XHVyGosZZTWsRkqiRsVA==',key_name='tempest-keypair-933133359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed3cec81bee74bf3913ab4fcab11a000',ramdisk_id='',reservation_id='r-u7cn8k51',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2003689595',owner_user_name='tempest-TaggedBootDevicesTest_v242-2003689595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:38:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad8d119c32e141afa9b00aa63bcc6770',uuid=ee4d14ad-8bd2-4b8b-9526-51abafe757f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebb9bc95-98ee-43f1-bd95-8a3da5497c72", "address": "fa:16:3e:17:f5:ed", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb9bc95-98", "ovs_interfaceid": "ebb9bc95-98ee-43f1-bd95-8a3da5497c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:39:12.235647 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converting VIF {"id": "ebb9bc95-98ee-43f1-bd95-8a3da5497c72", "address": "fa:16:3e:17:f5:ed", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb9bc95-98", "ovs_interfaceid": "ebb9bc95-98ee-43f1-bd95-8a3da5497c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:39:12.236253 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:f5:ed,bridge_name='br-int',has_traffic_filtering=True,id=ebb9bc95-98ee-43f1-bd95-8a3da5497c72,network=Network(31cceee4-a969-4779-8176-2f0fe765d595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapebb9bc95-98') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:39:12.240040 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-973724914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-973724914',id=15,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXXNelE8aiksVglbu5IxieekgunImq0N8+gB4i90SwlKOgJ5jLGESQZW447OC9RX/nj6CZ9Xqc+BXv17PDZZ0k5ralnrDScL3N6RSoxQIMTo0XHVyGosZZTWsRkqiRsVA==',key_name='tempest-keypair-933133359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed3cec81bee74bf3913ab4fcab11a000',ramdisk_id='',reservation_id='r-u7cn8k51',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2003689595',owner_user_name='tempest-TaggedBootDevicesTest_v242-2003689595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:38:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad8d119c32e141afa9b00aa63bcc6770',uuid=ee4d14ad-8bd2-4b8b-9526-51abafe757f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcce8bc4-9171-4ef4-b762-37d89aea863b", "address": "fa:16:3e:ec:35:bf", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcce8bc4-91", "ovs_interfaceid": "dcce8bc4-9171-4ef4-b762-37d89aea863b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:39:12.240040 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converting VIF {"id": "dcce8bc4-9171-4ef4-b762-37d89aea863b", "address": "fa:16:3e:ec:35:bf", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcce8bc4-91", "ovs_interfaceid": "dcce8bc4-9171-4ef4-b762-37d89aea863b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:39:12.240040 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:35:bf,bridge_name='br-int',has_traffic_filtering=True,id=dcce8bc4-9171-4ef4-b762-37d89aea863b,network=Network(31cceee4-a969-4779-8176-2f0fe765d595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdcce8bc4-91') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:39:12.241033 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-973724914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-973724914',id=15,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXXNelE8aiksVglbu5IxieekgunImq0N8+gB4i90SwlKOgJ5jLGESQZW447OC9RX/nj6CZ9Xqc+BXv17PDZZ0k5ralnrDScL3N6RSoxQIMTo0XHVyGosZZTWsRkqiRsVA==',key_name='tempest-keypair-933133359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed3cec81bee74bf3913ab4fcab11a000',ramdisk_id='',reservation_id='r-u7cn8k51',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2003689595',owner_user_name='tempest-TaggedBootDevicesTest_v242-2003689595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:38:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad8d119c32e141afa9b00aa63bcc6770',uuid=ee4d14ad-8bd2-4b8b-9526-51abafe757f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9882d815-8273-4eb8-937b-a1c1e4af4018", "address": "fa:16:3e:52:9c:9b", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9882d815-82", "ovs_interfaceid": "9882d815-8273-4eb8-937b-a1c1e4af4018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:39:12.242335 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converting VIF {"id": "9882d815-8273-4eb8-937b-a1c1e4af4018", "address": "fa:16:3e:52:9c:9b", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9882d815-82", "ovs_interfaceid": "9882d815-8273-4eb8-937b-a1c1e4af4018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:39:12.243221 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:9c:9b,bridge_name='br-int',has_traffic_filtering=True,id=9882d815-8273-4eb8-937b-a1c1e4af4018,network=Network(31cceee4-a969-4779-8176-2f0fe765d595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9882d815-82') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:39:12.245782 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-1883ed01-63d3-48f9-a64e-c7da1be5f602 req-629bafba-de2c-44ba-bdc2-9b9d5ced8b4f service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:12.248566 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-973724914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-973724914',id=15,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXXNelE8aiksVglbu5IxieekgunImq0N8+gB4i90SwlKOgJ5jLGESQZW447OC9RX/nj6CZ9Xqc+BXv17PDZZ0k5ralnrDScL3N6RSoxQIMTo0XHVyGosZZTWsRkqiRsVA==',key_name='tempest-keypair-933133359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed3cec81bee74bf3913ab4fcab11a000',ramdisk_id='',reservation_id='r-u7cn8k51',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2003689595',owner_user_name='tempest-TaggedBootDevicesTest_v242-2003689595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:38:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad8d119c32e141afa9b00aa63bcc6770',uuid=ee4d14ad-8bd2-4b8b-9526-51abafe757f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d782392-1caa-4b0a-b7e2-58c03357a004", "address": "fa:16:3e:ac:bc:0b", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d782392-1c", "ovs_interfaceid": "8d782392-1caa-4b0a-b7e2-58c03357a004", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:39:12.248995 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converting VIF {"id": "8d782392-1caa-4b0a-b7e2-58c03357a004", "address": "fa:16:3e:ac:bc:0b", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d782392-1c", "ovs_interfaceid": "8d782392-1caa-4b0a-b7e2-58c03357a004", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:39:12.250168 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:bc:0b,bridge_name='br-int',has_traffic_filtering=True,id=8d782392-1caa-4b0a-b7e2-58c03357a004,network=Network(31cceee4-a969-4779-8176-2f0fe765d595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d782392-1c') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:39:12.251558 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-973724914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-973724914',id=15,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXXNelE8aiksVglbu5IxieekgunImq0N8+gB4i90SwlKOgJ5jLGESQZW447OC9RX/nj6CZ9Xqc+BXv17PDZZ0k5ralnrDScL3N6RSoxQIMTo0XHVyGosZZTWsRkqiRsVA==',key_name='tempest-keypair-933133359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed3cec81bee74bf3913ab4fcab11a000',ramdisk_id='',reservation_id='r-u7cn8k51',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2003689595',owner_user_name='tempest-TaggedBootDevicesTest_v242-2003689595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:38:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad8d119c32e141afa9b00aa63bcc6770',uuid=ee4d14ad-8bd2-4b8b-9526-51abafe757f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45a4f3f8-69ee-4cc0-811e-a1178c8b18f2", "address": "fa:16:3e:b3:64:e7", "network": {"id": "567865ec-590f-489f-ba94-79b2150230b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-814227769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a4f3f8-69", "ovs_interfaceid": "45a4f3f8-69ee-4cc0-811e-a1178c8b18f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:39:12.251747 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converting VIF {"id": "45a4f3f8-69ee-4cc0-811e-a1178c8b18f2", "address": "fa:16:3e:b3:64:e7", "network": {"id": "567865ec-590f-489f-ba94-79b2150230b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-814227769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a4f3f8-69", "ovs_interfaceid": "45a4f3f8-69ee-4cc0-811e-a1178c8b18f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:39:12.252579 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:64:e7,bridge_name='br-int',has_traffic_filtering=True,id=45a4f3f8-69ee-4cc0-811e-a1178c8b18f2,network=Network(567865ec-590f-489f-ba94-79b2150230b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45a4f3f8-69') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:39:12.253276 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-973724914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-973724914',id=15,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXXNelE8aiksVglbu5IxieekgunImq0N8+gB4i90SwlKOgJ5jLGESQZW447OC9RX/nj6CZ9Xqc+BXv17PDZZ0k5ralnrDScL3N6RSoxQIMTo0XHVyGosZZTWsRkqiRsVA==',key_name='tempest-keypair-933133359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed3cec81bee74bf3913ab4fcab11a000',ramdisk_id='',reservation_id='r-u7cn8k51',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2003689595',owner_user_name='tempest-TaggedBootDevicesTest_v242-2003689595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:38:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad8d119c32e141afa9b00aa63bcc6770',uuid=ee4d14ad-8bd2-4b8b-9526-51abafe757f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2ff0bc1-8b84-4517-b347-f78bb6a9e14c", "address": "fa:16:3e:6a:a4:65", "network": {"id": "567865ec-590f-489f-ba94-79b2150230b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-814227769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ff0bc1-8b", "ovs_interfaceid": "c2ff0bc1-8b84-4517-b347-f78bb6a9e14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:39:12.253465 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converting VIF {"id": "c2ff0bc1-8b84-4517-b347-f78bb6a9e14c", "address": "fa:16:3e:6a:a4:65", "network": {"id": "567865ec-590f-489f-ba94-79b2150230b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-814227769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ff0bc1-8b", "ovs_interfaceid": "c2ff0bc1-8b84-4517-b347-f78bb6a9e14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:39:12.257561 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:a4:65,bridge_name='br-int',has_traffic_filtering=True,id=c2ff0bc1-8b84-4517-b347-f78bb6a9e14c,network=Network(567865ec-590f-489f-ba94-79b2150230b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ff0bc1-8b') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:39:12.260254 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212147b0-26de-42cd-b43d-057ec8d61c72/disk --force-share --output=json" returned: 0 in 0.104s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:12.262495 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lazy-loading 'pci_devices' on Instance uuid ee4d14ad-8bd2-4b8b-9526-51abafe757f2 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:12.277038 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4a4a7e-d584-427e-91d2-7d9e710ea2a3/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:12.326078 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:39:12.326706 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] VM Started (Lifecycle Event) Jun 26 10:39:12.352298 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-095295f3-8742-4092-9a9b-3ba6ba1ae38a req-8a1a0855-4e19-482c-a108-d86f1759fb97 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Updated VIF entry in instance network info cache for port 061a7108-6f47-4def-b12d-38eb13d382f6. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:39:12.353718 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-095295f3-8742-4092-9a9b-3ba6ba1ae38a req-8a1a0855-4e19-482c-a108-d86f1759fb97 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Updating instance_info_cache with network_info: [{"id": "061a7108-6f47-4def-b12d-38eb13d382f6", "address": "fa:16:3e:48:bc:a4", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap061a7108-6f", "ovs_interfaceid": "061a7108-6f47-4def-b12d-38eb13d382f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:39:12.367107 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-1883ed01-63d3-48f9-a64e-c7da1be5f602 req-629bafba-de2c-44ba-bdc2-9b9d5ced8b4f service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:39:12.384536 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4a4a7e-d584-427e-91d2-7d9e710ea2a3/disk --force-share --output=json" returned: 0 in 0.108s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:12.385041 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4a4a7e-d584-427e-91d2-7d9e710ea2a3/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:12.443134 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:12.471825 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-1f698fcd-77c1-4841-951e-e7b1703c6fc3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:39:12.472213 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-1f698fcd-77c1-4841-951e-e7b1703c6fc3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:39:12.515131 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4a4a7e-d584-427e-91d2-7d9e710ea2a3/disk --force-share --output=json" returned: 0 in 0.130s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:12.518975 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:12.626227 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:12.627188 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:12.655852 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-1883ed01-63d3-48f9-a64e-c7da1be5f602 req-629bafba-de2c-44ba-bdc2-9b9d5ced8b4f service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:39:12.740762 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:12.744199 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] End _get_guest_xml xml= Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: ee4d14ad-8bd2-4b8b-9526-51abafe757f2 Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: instance-0000000f Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: 196608 Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: tempest-device-tagging-server-973724914 Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: 2026-06-26 10:39:01 Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: 192 Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: 0 Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: 0 Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: True Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: bare Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: 0 Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: virtio Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: tempest-TaggedBootDevicesTest_v242-2003689595-project-member Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: tempest-TaggedBootDevicesTest_v242-2003689595 Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: ee4d14ad-8bd2-4b8b-9526-51abafe757f2 Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: ee4d14ad-8bd2-4b8b-9526-51abafe757f2 Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: hvm Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: 128 Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: 0fe657ee-bc44-41d2-b197-f986995424e2 Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: 3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: eab5497d-64ad-45f7-af05-50cde809958d Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: Jun 26 10:39:12.774832 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:39:12.778260 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Preparing to wait for external event network-vif-plugged-49031ae0-122b-4f20-8d73-20048a6ad965 {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:39:12.778260 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:12.778260 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:12.778260 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:12.778260 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Preparing to wait for external event network-vif-plugged-ebb9bc95-98ee-43f1-bd95-8a3da5497c72 {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:39:12.778260 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:12.778260 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:12.778260 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:12.778260 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Preparing to wait for external event network-vif-plugged-dcce8bc4-9171-4ef4-b762-37d89aea863b {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:39:12.778260 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:12.778260 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:12.778260 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:12.778260 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Preparing to wait for external event network-vif-plugged-9882d815-8273-4eb8-937b-a1c1e4af4018 {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:39:12.778260 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:12.778260 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:12.778260 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:12.778830 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Preparing to wait for external event network-vif-plugged-8d782392-1caa-4b0a-b7e2-58c03357a004 {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:39:12.778830 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:12.778830 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:12.778912 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:12.778989 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Preparing to wait for external event network-vif-plugged-45a4f3f8-69ee-4cc0-811e-a1178c8b18f2 {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:39:12.779127 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:12.779273 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:12.779436 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:12.779560 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Preparing to wait for external event network-vif-plugged-c2ff0bc1-8b84-4517-b347-f78bb6a9e14c {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:39:12.779642 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:12.779789 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:12.779882 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:12.781067 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-973724914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-973724914',id=15,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXXNelE8aiksVglbu5IxieekgunImq0N8+gB4i90SwlKOgJ5jLGESQZW447OC9RX/nj6CZ9Xqc+BXv17PDZZ0k5ralnrDScL3N6RSoxQIMTo0XHVyGosZZTWsRkqiRsVA==',key_name='tempest-keypair-933133359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed3cec81bee74bf3913ab4fcab11a000',ramdisk_id='',reservation_id='r-u7cn8k51',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2003689595',owner_user_name='tempest-TaggedBootDevicesTest_v242-2003689595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:38:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad8d119c32e141afa9b00aa63bcc6770',uuid=ee4d14ad-8bd2-4b8b-9526-51abafe757f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "49031ae0-122b-4f20-8d73-20048a6ad965", "address": "fa:16:3e:fd:10:20", "network": {"id": "8142386b-fc69-434d-9373-4536e94d3e62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-385739110-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49031ae0-12", "ovs_interfaceid": "49031ae0-122b-4f20-8d73-20048a6ad965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:39:12.781263 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converting VIF {"id": "49031ae0-122b-4f20-8d73-20048a6ad965", "address": "fa:16:3e:fd:10:20", "network": {"id": "8142386b-fc69-434d-9373-4536e94d3e62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-385739110-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49031ae0-12", "ovs_interfaceid": "49031ae0-122b-4f20-8d73-20048a6ad965", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:39:12.782104 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:fd:10:20,bridge_name='br-int',has_traffic_filtering=True,id=49031ae0-122b-4f20-8d73-20048a6ad965,network=Network(8142386b-fc69-434d-9373-4536e94d3e62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49031ae0-12') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:39:12.782350 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:10:20,bridge_name='br-int',has_traffic_filtering=True,id=49031ae0-122b-4f20-8d73-20048a6ad965,network=Network(8142386b-fc69-434d-9373-4536e94d3e62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49031ae0-12') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:39:12.782801 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:12.783243 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:12.783681 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:39:12.785404 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:12.785629 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'bde0bea5-ed1d-5bbd-841a-8fc741130ba9', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:12.786516 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:12.787545 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:39:12.788145 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:12.791091 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:12.791332 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap49031ae0-12, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:12.792024 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap49031ae0-12, col_values=(('qos', UUID('1de1b156-fb2f-45c2-8736-3203348332ac')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:12.792372 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap49031ae0-12, col_values=(('external_ids', {'iface-id': '49031ae0-122b-4f20-8d73-20048a6ad965', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:fd:10:20', 'vm-uuid': 'ee4d14ad-8bd2-4b8b-9526-51abafe757f2'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:12.793741 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:12.795622 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:39:12.802989 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:12.804251 np0000003731 nova-compute[98967]: INFO os_vif [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:fd:10:20,bridge_name='br-int',has_traffic_filtering=True,id=49031ae0-122b-4f20-8d73-20048a6ad965,network=Network(8142386b-fc69-434d-9373-4536e94d3e62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49031ae0-12') Jun 26 10:39:12.805113 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-973724914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-973724914',id=15,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXXNelE8aiksVglbu5IxieekgunImq0N8+gB4i90SwlKOgJ5jLGESQZW447OC9RX/nj6CZ9Xqc+BXv17PDZZ0k5ralnrDScL3N6RSoxQIMTo0XHVyGosZZTWsRkqiRsVA==',key_name='tempest-keypair-933133359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed3cec81bee74bf3913ab4fcab11a000',ramdisk_id='',reservation_id='r-u7cn8k51',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2003689595',owner_user_name='tempest-TaggedBootDevicesTest_v242-2003689595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:38:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad8d119c32e141afa9b00aa63bcc6770',uuid=ee4d14ad-8bd2-4b8b-9526-51abafe757f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "ebb9bc95-98ee-43f1-bd95-8a3da5497c72", "address": "fa:16:3e:17:f5:ed", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb9bc95-98", "ovs_interfaceid": "ebb9bc95-98ee-43f1-bd95-8a3da5497c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:39:12.805301 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converting VIF {"id": "ebb9bc95-98ee-43f1-bd95-8a3da5497c72", "address": "fa:16:3e:17:f5:ed", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb9bc95-98", "ovs_interfaceid": "ebb9bc95-98ee-43f1-bd95-8a3da5497c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:39:12.805924 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:f5:ed,bridge_name='br-int',has_traffic_filtering=True,id=ebb9bc95-98ee-43f1-bd95-8a3da5497c72,network=Network(31cceee4-a969-4779-8176-2f0fe765d595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapebb9bc95-98') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:39:12.806241 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:f5:ed,bridge_name='br-int',has_traffic_filtering=True,id=ebb9bc95-98ee-43f1-bd95-8a3da5497c72,network=Network(31cceee4-a969-4779-8176-2f0fe765d595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapebb9bc95-98') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:39:12.806616 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:12.806895 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:12.807176 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:39:12.808369 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:12.809341 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '7e314c3e-891d-5bfa-a2b2-29bfac6e8510', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:12.810123 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:12.810921 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:39:12.817070 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:12.819820 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:12.820074 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapebb9bc95-98, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:12.820479 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapebb9bc95-98, col_values=(('qos', UUID('f429f636-ab05-4bb9-842f-3aa9c8220937')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:12.820655 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapebb9bc95-98, col_values=(('external_ids', {'iface-id': 'ebb9bc95-98ee-43f1-bd95-8a3da5497c72', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:17:f5:ed', 'vm-uuid': 'ee4d14ad-8bd2-4b8b-9526-51abafe757f2'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:12.821598 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:12.823141 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:39:12.833580 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:12.833580 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:12.848527 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:12.851404 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:12.856276 np0000003731 nova-compute[98967]: INFO os_vif [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:f5:ed,bridge_name='br-int',has_traffic_filtering=True,id=ebb9bc95-98ee-43f1-bd95-8a3da5497c72,network=Network(31cceee4-a969-4779-8176-2f0fe765d595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapebb9bc95-98') Jun 26 10:39:12.863331 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-973724914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-973724914',id=15,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXXNelE8aiksVglbu5IxieekgunImq0N8+gB4i90SwlKOgJ5jLGESQZW447OC9RX/nj6CZ9Xqc+BXv17PDZZ0k5ralnrDScL3N6RSoxQIMTo0XHVyGosZZTWsRkqiRsVA==',key_name='tempest-keypair-933133359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed3cec81bee74bf3913ab4fcab11a000',ramdisk_id='',reservation_id='r-u7cn8k51',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2003689595',owner_user_name='tempest-TaggedBootDevicesTest_v242-2003689595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:38:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad8d119c32e141afa9b00aa63bcc6770',uuid=ee4d14ad-8bd2-4b8b-9526-51abafe757f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "dcce8bc4-9171-4ef4-b762-37d89aea863b", "address": "fa:16:3e:ec:35:bf", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcce8bc4-91", "ovs_interfaceid": "dcce8bc4-9171-4ef4-b762-37d89aea863b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:39:12.863848 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-095295f3-8742-4092-9a9b-3ba6ba1ae38a req-8a1a0855-4e19-482c-a108-d86f1759fb97 service nova] Releasing lock "refresh_cache-c1043abd-b0c0-439e-b065-8bef627483cb" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:39:12.864817 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converting VIF {"id": "dcce8bc4-9171-4ef4-b762-37d89aea863b", "address": "fa:16:3e:ec:35:bf", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcce8bc4-91", "ovs_interfaceid": "dcce8bc4-9171-4ef4-b762-37d89aea863b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:39:12.866362 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-095295f3-8742-4092-9a9b-3ba6ba1ae38a req-8a1a0855-4e19-482c-a108-d86f1759fb97 service nova] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Received event network-changed-b747180c-b090-4936-90bc-0c6553817170 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:12.866890 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:35:bf,bridge_name='br-int',has_traffic_filtering=True,id=dcce8bc4-9171-4ef4-b762-37d89aea863b,network=Network(31cceee4-a969-4779-8176-2f0fe765d595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdcce8bc4-91') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:39:12.867995 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-095295f3-8742-4092-9a9b-3ba6ba1ae38a req-8a1a0855-4e19-482c-a108-d86f1759fb97 service nova] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Refreshing instance network info cache due to event network-changed-b747180c-b090-4936-90bc-0c6553817170. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:39:12.868742 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:35:bf,bridge_name='br-int',has_traffic_filtering=True,id=dcce8bc4-9171-4ef4-b762-37d89aea863b,network=Network(31cceee4-a969-4779-8176-2f0fe765d595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdcce8bc4-91') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:39:12.869192 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Paused> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:39:12.869611 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-095295f3-8742-4092-9a9b-3ba6ba1ae38a req-8a1a0855-4e19-482c-a108-d86f1759fb97 service nova] Acquiring lock "refresh_cache-f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:39:12.870466 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:12.870466 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:12.870707 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-095295f3-8742-4092-9a9b-3ba6ba1ae38a req-8a1a0855-4e19-482c-a108-d86f1759fb97 service nova] Acquired lock "refresh_cache-f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:39:12.870954 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:39:12.872492 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] VM Paused (Lifecycle Event) Jun 26 10:39:12.874520 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-095295f3-8742-4092-9a9b-3ba6ba1ae38a req-8a1a0855-4e19-482c-a108-d86f1759fb97 service nova] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Refreshing network info cache for port b747180c-b090-4936-90bc-0c6553817170 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:39:12.877074 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:12.877074 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '1374140b-8440-5fdf-99da-ff9091480b45', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:12.877871 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:12.879113 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:39:12.891823 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:12.894668 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:12.894668 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapdcce8bc4-91, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:12.894971 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapdcce8bc4-91, col_values=(('qos', UUID('f07addf2-c998-4f83-8d7a-88872e64cbab')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:12.895059 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapdcce8bc4-91, col_values=(('external_ids', {'iface-id': 'dcce8bc4-9171-4ef4-b762-37d89aea863b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ec:35:bf', 'vm-uuid': 'ee4d14ad-8bd2-4b8b-9526-51abafe757f2'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:12.896862 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:12.898682 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:39:12.916845 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:12.918030 np0000003731 nova-compute[98967]: INFO os_vif [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:35:bf,bridge_name='br-int',has_traffic_filtering=True,id=dcce8bc4-9171-4ef4-b762-37d89aea863b,network=Network(31cceee4-a969-4779-8176-2f0fe765d595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdcce8bc4-91') Jun 26 10:39:12.919125 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-973724914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-973724914',id=15,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXXNelE8aiksVglbu5IxieekgunImq0N8+gB4i90SwlKOgJ5jLGESQZW447OC9RX/nj6CZ9Xqc+BXv17PDZZ0k5ralnrDScL3N6RSoxQIMTo0XHVyGosZZTWsRkqiRsVA==',key_name='tempest-keypair-933133359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed3cec81bee74bf3913ab4fcab11a000',ramdisk_id='',reservation_id='r-u7cn8k51',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2003689595',owner_user_name='tempest-TaggedBootDevicesTest_v242-2003689595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:38:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad8d119c32e141afa9b00aa63bcc6770',uuid=ee4d14ad-8bd2-4b8b-9526-51abafe757f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "9882d815-8273-4eb8-937b-a1c1e4af4018", "address": "fa:16:3e:52:9c:9b", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9882d815-82", "ovs_interfaceid": "9882d815-8273-4eb8-937b-a1c1e4af4018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:39:12.919397 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converting VIF {"id": "9882d815-8273-4eb8-937b-a1c1e4af4018", "address": "fa:16:3e:52:9c:9b", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9882d815-82", "ovs_interfaceid": "9882d815-8273-4eb8-937b-a1c1e4af4018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:39:12.920106 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:9c:9b,bridge_name='br-int',has_traffic_filtering=True,id=9882d815-8273-4eb8-937b-a1c1e4af4018,network=Network(31cceee4-a969-4779-8176-2f0fe765d595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9882d815-82') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:39:12.920395 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:9c:9b,bridge_name='br-int',has_traffic_filtering=True,id=9882d815-8273-4eb8-937b-a1c1e4af4018,network=Network(31cceee4-a969-4779-8176-2f0fe765d595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9882d815-82') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:39:12.920821 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:12.921133 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:12.921300 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:39:12.923311 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:12.923456 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'a6b152f8-8e69-522e-bdd3-5d82ddb4d88a', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:12.924355 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:12.924936 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:39:12.930149 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk --force-share --output=json" returned: 0 in 0.097s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:12.936603 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:39:12.937988 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:12.954722 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:12.966199 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:12.966199 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap9882d815-82, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:12.967114 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap9882d815-82, col_values=(('qos', UUID('969bbc3c-a42f-4b90-ac82-3eca90f4edfb')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:12.967885 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap9882d815-82, col_values=(('external_ids', {'iface-id': '9882d815-8273-4eb8-937b-a1c1e4af4018', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:52:9c:9b', 'vm-uuid': 'ee4d14ad-8bd2-4b8b-9526-51abafe757f2'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:12.969324 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:12.971084 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:39:12.978239 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "env LANG=C uptime" returned: 0 in 0.040s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:12.978630 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Hypervisor/Node resource view: name=np0000003731 free_ram=49815MB free_disk=74.11566162109375GB free_vcpus=7 pci_devices=[{"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98967) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 26 10:39:12.978798 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:12.982231 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-1f698fcd-77c1-4841-951e-e7b1703c6fc3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:39:12.995947 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:12.997283 np0000003731 nova-compute[98967]: INFO os_vif [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:9c:9b,bridge_name='br-int',has_traffic_filtering=True,id=9882d815-8273-4eb8-937b-a1c1e4af4018,network=Network(31cceee4-a969-4779-8176-2f0fe765d595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9882d815-82') Jun 26 10:39:12.998533 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-973724914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-973724914',id=15,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXXNelE8aiksVglbu5IxieekgunImq0N8+gB4i90SwlKOgJ5jLGESQZW447OC9RX/nj6CZ9Xqc+BXv17PDZZ0k5ralnrDScL3N6RSoxQIMTo0XHVyGosZZTWsRkqiRsVA==',key_name='tempest-keypair-933133359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed3cec81bee74bf3913ab4fcab11a000',ramdisk_id='',reservation_id='r-u7cn8k51',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2003689595',owner_user_name='tempest-TaggedBootDevicesTest_v242-2003689595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:38:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad8d119c32e141afa9b00aa63bcc6770',uuid=ee4d14ad-8bd2-4b8b-9526-51abafe757f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "8d782392-1caa-4b0a-b7e2-58c03357a004", "address": "fa:16:3e:ac:bc:0b", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d782392-1c", "ovs_interfaceid": "8d782392-1caa-4b0a-b7e2-58c03357a004", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:39:12.998791 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converting VIF {"id": "8d782392-1caa-4b0a-b7e2-58c03357a004", "address": "fa:16:3e:ac:bc:0b", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d782392-1c", "ovs_interfaceid": "8d782392-1caa-4b0a-b7e2-58c03357a004", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:39:12.999564 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:bc:0b,bridge_name='br-int',has_traffic_filtering=True,id=8d782392-1caa-4b0a-b7e2-58c03357a004,network=Network(31cceee4-a969-4779-8176-2f0fe765d595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d782392-1c') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:39:12.999888 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:bc:0b,bridge_name='br-int',has_traffic_filtering=True,id=8d782392-1caa-4b0a-b7e2-58c03357a004,network=Network(31cceee4-a969-4779-8176-2f0fe765d595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d782392-1c') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:39:13.000303 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:13.000830 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:13.001520 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:39:13.003150 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:13.003387 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'f673db27-bfd5-5483-9e8d-6ab3822538b7', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:13.004272 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:13.005041 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:39:13.017318 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "c1043abd-b0c0-439e-b065-8bef627483cb" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.520s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:13.029558 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:13.032893 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:13.033365 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap8d782392-1c, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:13.033787 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap8d782392-1c, col_values=(('qos', UUID('cb0307b6-0039-4926-9fe1-216158a0a23e')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:13.034545 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap8d782392-1c, col_values=(('external_ids', {'iface-id': '8d782392-1caa-4b0a-b7e2-58c03357a004', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:ac:bc:0b', 'vm-uuid': 'ee4d14ad-8bd2-4b8b-9526-51abafe757f2'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:13.037431 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:13.038672 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:39:13.071874 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:13.072961 np0000003731 nova-compute[98967]: INFO os_vif [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:bc:0b,bridge_name='br-int',has_traffic_filtering=True,id=8d782392-1caa-4b0a-b7e2-58c03357a004,network=Network(31cceee4-a969-4779-8176-2f0fe765d595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d782392-1c') Jun 26 10:39:13.073712 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-973724914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-973724914',id=15,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXXNelE8aiksVglbu5IxieekgunImq0N8+gB4i90SwlKOgJ5jLGESQZW447OC9RX/nj6CZ9Xqc+BXv17PDZZ0k5ralnrDScL3N6RSoxQIMTo0XHVyGosZZTWsRkqiRsVA==',key_name='tempest-keypair-933133359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed3cec81bee74bf3913ab4fcab11a000',ramdisk_id='',reservation_id='r-u7cn8k51',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2003689595',owner_user_name='tempest-TaggedBootDevicesTest_v242-2003689595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:38:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad8d119c32e141afa9b00aa63bcc6770',uuid=ee4d14ad-8bd2-4b8b-9526-51abafe757f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "45a4f3f8-69ee-4cc0-811e-a1178c8b18f2", "address": "fa:16:3e:b3:64:e7", "network": {"id": "567865ec-590f-489f-ba94-79b2150230b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-814227769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a4f3f8-69", "ovs_interfaceid": "45a4f3f8-69ee-4cc0-811e-a1178c8b18f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:39:13.073953 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converting VIF {"id": "45a4f3f8-69ee-4cc0-811e-a1178c8b18f2", "address": "fa:16:3e:b3:64:e7", "network": {"id": "567865ec-590f-489f-ba94-79b2150230b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-814227769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a4f3f8-69", "ovs_interfaceid": "45a4f3f8-69ee-4cc0-811e-a1178c8b18f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:39:13.074507 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:64:e7,bridge_name='br-int',has_traffic_filtering=True,id=45a4f3f8-69ee-4cc0-811e-a1178c8b18f2,network=Network(567865ec-590f-489f-ba94-79b2150230b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45a4f3f8-69') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:39:13.074752 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:64:e7,bridge_name='br-int',has_traffic_filtering=True,id=45a4f3f8-69ee-4cc0-811e-a1178c8b18f2,network=Network(567865ec-590f-489f-ba94-79b2150230b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45a4f3f8-69') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:39:13.075062 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:13.075290 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:13.075506 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:39:13.076399 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:13.076615 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'be8cd7ed-bc2b-5a44-81ee-197db83053b9', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:13.079799 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:13.080780 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:39:13.110378 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:13.114320 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:13.114582 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap45a4f3f8-69, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:13.114948 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap45a4f3f8-69, col_values=(('qos', UUID('5dbb6c78-f7fd-4b84-9c67-b94e36e446e6')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:13.115118 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap45a4f3f8-69, col_values=(('external_ids', {'iface-id': '45a4f3f8-69ee-4cc0-811e-a1178c8b18f2', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:b3:64:e7', 'vm-uuid': 'ee4d14ad-8bd2-4b8b-9526-51abafe757f2'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:13.116070 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:13.117270 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:39:13.143066 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:13.144666 np0000003731 nova-compute[98967]: INFO os_vif [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:64:e7,bridge_name='br-int',has_traffic_filtering=True,id=45a4f3f8-69ee-4cc0-811e-a1178c8b18f2,network=Network(567865ec-590f-489f-ba94-79b2150230b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45a4f3f8-69') Jun 26 10:39:13.145860 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-973724914',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-973724914',id=15,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXXNelE8aiksVglbu5IxieekgunImq0N8+gB4i90SwlKOgJ5jLGESQZW447OC9RX/nj6CZ9Xqc+BXv17PDZZ0k5ralnrDScL3N6RSoxQIMTo0XHVyGosZZTWsRkqiRsVA==',key_name='tempest-keypair-933133359',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ed3cec81bee74bf3913ab4fcab11a000',ramdisk_id='',reservation_id='r-u7cn8k51',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedBootDevicesTest_v242-2003689595',owner_user_name='tempest-TaggedBootDevicesTest_v242-2003689595-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:38:42Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad8d119c32e141afa9b00aa63bcc6770',uuid=ee4d14ad-8bd2-4b8b-9526-51abafe757f2,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "c2ff0bc1-8b84-4517-b347-f78bb6a9e14c", "address": "fa:16:3e:6a:a4:65", "network": {"id": "567865ec-590f-489f-ba94-79b2150230b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-814227769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ff0bc1-8b", "ovs_interfaceid": "c2ff0bc1-8b84-4517-b347-f78bb6a9e14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:39:13.146125 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converting VIF {"id": "c2ff0bc1-8b84-4517-b347-f78bb6a9e14c", "address": "fa:16:3e:6a:a4:65", "network": {"id": "567865ec-590f-489f-ba94-79b2150230b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-814227769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ff0bc1-8b", "ovs_interfaceid": "c2ff0bc1-8b84-4517-b347-f78bb6a9e14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:39:13.149281 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:a4:65,bridge_name='br-int',has_traffic_filtering=True,id=c2ff0bc1-8b84-4517-b347-f78bb6a9e14c,network=Network(567865ec-590f-489f-ba94-79b2150230b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ff0bc1-8b') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:39:13.149634 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:a4:65,bridge_name='br-int',has_traffic_filtering=True,id=c2ff0bc1-8b84-4517-b347-f78bb6a9e14c,network=Network(567865ec-590f-489f-ba94-79b2150230b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ff0bc1-8b') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:39:13.150798 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:13.151136 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:13.151244 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:39:13.153598 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:13.153598 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '0213ff32-a659-5a2b-8d24-afffafb1d23a', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:13.154803 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:13.155736 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:39:13.161131 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-1883ed01-63d3-48f9-a64e-c7da1be5f602 req-629bafba-de2c-44ba-bdc2-9b9d5ced8b4f service nova] Releasing lock "refresh_cache-b53c3532-08c2-4c05-b5e5-c217d3ef4d9a" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:39:13.161775 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquired lock "refresh_cache-b53c3532-08c2-4c05-b5e5-c217d3ef4d9a" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:39:13.162122 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:39:13.193192 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:13.197232 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:13.197362 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapc2ff0bc1-8b, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:13.197790 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapc2ff0bc1-8b, col_values=(('qos', UUID('6acc1314-6a0c-4493-8886-6e9c9f935144')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:13.198546 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapc2ff0bc1-8b, col_values=(('external_ids', {'iface-id': 'c2ff0bc1-8b84-4517-b347-f78bb6a9e14c', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:6a:a4:65', 'vm-uuid': 'ee4d14ad-8bd2-4b8b-9526-51abafe757f2'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:13.199469 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:13.201544 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:39:13.245892 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:13.248737 np0000003731 nova-compute[98967]: INFO os_vif [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:a4:65,bridge_name='br-int',has_traffic_filtering=True,id=c2ff0bc1-8b84-4517-b347-f78bb6a9e14c,network=Network(567865ec-590f-489f-ba94-79b2150230b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ff0bc1-8b') Jun 26 10:39:13.378080 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:13.379207 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-095295f3-8742-4092-9a9b-3ba6ba1ae38a req-8a1a0855-4e19-482c-a108-d86f1759fb97 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:13.382957 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:39:13.492111 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-1f698fcd-77c1-4841-951e-e7b1703c6fc3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.257s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:13.493934 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 0.515s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:13.579030 np0000003731 nova-compute[98967]: INFO nova.scheduler.client.report [None req-1f698fcd-77c1-4841-951e-e7b1703c6fc3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Deleted allocations for instance 81a0f65d-2017-4275-aabe-88bc8c81225d Jun 26 10:39:13.717188 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:13.781631 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:39:13.806721 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-5a0560b8-0d8e-4289-861c-907488f23442 req-929b288f-499e-43f2-aa2e-139ecf987d0d service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Received event network-vif-plugged-fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:13.806949 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5a0560b8-0d8e-4289-861c-907488f23442 req-929b288f-499e-43f2-aa2e-139ecf987d0d service nova] Acquiring lock "3a56a898-691e-473e-a5c1-d618e861087b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:13.807245 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5a0560b8-0d8e-4289-861c-907488f23442 req-929b288f-499e-43f2-aa2e-139ecf987d0d service nova] Lock "3a56a898-691e-473e-a5c1-d618e861087b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:13.807432 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5a0560b8-0d8e-4289-861c-907488f23442 req-929b288f-499e-43f2-aa2e-139ecf987d0d service nova] Lock "3a56a898-691e-473e-a5c1-d618e861087b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:13.808900 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-5a0560b8-0d8e-4289-861c-907488f23442 req-929b288f-499e-43f2-aa2e-139ecf987d0d service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Processing event network-vif-plugged-fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:39:13.809203 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-5a0560b8-0d8e-4289-861c-907488f23442 req-929b288f-499e-43f2-aa2e-139ecf987d0d service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Received event network-vif-plugged-fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:13.809436 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5a0560b8-0d8e-4289-861c-907488f23442 req-929b288f-499e-43f2-aa2e-139ecf987d0d service nova] Acquiring lock "3a56a898-691e-473e-a5c1-d618e861087b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:13.809893 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5a0560b8-0d8e-4289-861c-907488f23442 req-929b288f-499e-43f2-aa2e-139ecf987d0d service nova] Lock "3a56a898-691e-473e-a5c1-d618e861087b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:13.809893 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5a0560b8-0d8e-4289-861c-907488f23442 req-929b288f-499e-43f2-aa2e-139ecf987d0d service nova] Lock "3a56a898-691e-473e-a5c1-d618e861087b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:13.810000 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-5a0560b8-0d8e-4289-861c-907488f23442 req-929b288f-499e-43f2-aa2e-139ecf987d0d service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] No waiting events found dispatching network-vif-plugged-fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:39:13.810800 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-5a0560b8-0d8e-4289-861c-907488f23442 req-929b288f-499e-43f2-aa2e-139ecf987d0d service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Received unexpected event network-vif-plugged-fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df for instance with vm_state building and task_state spawning. Jun 26 10:39:13.810800 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Instance event wait completed in 1 seconds for network-vif-plugged {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:39:13.817148 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Guest created on hypervisor {{(pid=98967) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 26 10:39:13.822357 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Instance spawned successfully. Jun 26 10:39:13.829103 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 26 10:39:13.888290 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] During sync_power_state the instance has a pending task (spawning). Skip. Jun 26 10:39:13.888494 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:39:13.888728 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] VM Resumed (Lifecycle Event) Jun 26 10:39:14.003224 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-095295f3-8742-4092-9a9b-3ba6ba1ae38a req-8a1a0855-4e19-482c-a108-d86f1759fb97 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:14.022809 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:14.145370 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "c1043abd-b0c0-439e-b065-8bef627483cb" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:14.145839 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "c1043abd-b0c0-439e-b065-8bef627483cb" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:14.146248 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Attaching volume 1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d to /dev/vdb Jun 26 10:39:14.217191 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.79', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003731', 'execute': None}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:39:14.239366 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.scaleio [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98967) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 10:39:14.256164 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-095295f3-8742-4092-9a9b-3ba6ba1ae38a req-8a1a0855-4e19-482c-a108-d86f1759fb97 service nova] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Updated VIF entry in instance network info cache for port b747180c-b090-4936-90bc-0c6553817170. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:39:14.256935 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-095295f3-8742-4092-9a9b-3ba6ba1ae38a req-8a1a0855-4e19-482c-a108-d86f1759fb97 service nova] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Updating instance_info_cache with network_info: [{"id": "b747180c-b090-4936-90bc-0c6553817170", "address": "fa:16:3e:43:d8:28", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb747180c-b0", "ovs_interfaceid": "b747180c-b090-4936-90bc-0c6553817170", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:39:14.267040 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Updating instance_info_cache with network_info: [{"id": "43cc3477-2288-4c03-8374-5701e3d3baa1", "address": "fa:16:3e:0e:19:b0", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43cc3477-22", "ovs_interfaceid": "43cc3477-2288-4c03-8374-5701e3d3baa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:39:14.282039 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): nvme version {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:14.326519 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] 'nvme version' failed. Not Retrying. {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 10:39:14.326893 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.nvmeof [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] nvme not present on system {{(pid=98967) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 10:39:14.350698 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98967) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 10:39:14.350698 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.lightos [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Current host hostNQN and IP(s) are ['10.4.3.79', 'fe80::f816:3eff:fe55:ba34', '192.168.40.6', 'fe80::f816:3eff:fe6b:fe1a', '192.168.50.6', 'fe80::f816:3eff:feca:9cd0', '192.168.10.6', 'fe80::f816:3eff:feb4:4e78', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f8bb:38ff:fe28:ff4a', 'fe80::fc16:3eff:fe37:b3f6', 'fe80::41a:feff:fe02:479d', 'fe80::fc16:3eff:fe5e:459', 'fe80::fc16:3eff:fe90:be9c', 'fe80::84cb:23ff:fe8e:e6e6', 'fe80::fc16:3eff:fe5a:811a', 'fe80::fc16:3eff:fe1b:5509', 'fe80::fc16:3eff:fe48:bca4', 'fe80::fc16:3eff:fef2:781c', 'fe80::b448:c6ff:fe9c:a1e9', 'fe80::fc16:3eff:fe78:446c', 'fe80::fc16:3eff:fe43:d828', 'fe80::fc16:3eff:fe9c:6906', 'fe80::bc5e:80ff:fe69:218d'] Jun 26 10:39:14.350698 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 10:39:14.350698 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] LIGHTOS: no hostnqn found. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 10:39:14.350698 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] <== get_connector_properties: return (131ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.79', 'host': 'np0000003731', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:2fddcc2116d6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '7f2a0776-2f14-4357-a22e-baa6677eb22e', 'nvme_native_multipath': False} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:39:14.350698 np0000003731 nova-compute[98967]: DEBUG nova.virt.block_device [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Updating existing volume attachment record: 49883da9-3361-4a6a-afe6-3cbb1c561c27 {{(pid=98967) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 26 10:39:14.357524 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Found default for hw_cdrom_bus of ide {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:14.358382 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Found default for hw_disk_bus of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:14.358382 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Found default for hw_input_bus of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:14.359262 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Found default for hw_pointer_model of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:14.360130 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Found default for hw_video_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:14.360130 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Found default for hw_vif_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:14.393565 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:14.395917 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:39:14.583178 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance d26dc4db-d71c-43b9-811a-d39b111be119 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:39:14.583403 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:39:14.583571 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance 212147b0-26de-42cd-b43d-057ec8d61c72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:39:14.583701 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance 047061b2-340c-4cc9-899b-0744dad0081f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:39:14.583833 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance 25b12be8-e92b-4705-b668-05cfecaf66b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:39:14.583961 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance c1043abd-b0c0-439e-b065-8bef627483cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:39:14.584117 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance ee4d14ad-8bd2-4b8b-9526-51abafe757f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:39:14.584249 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance 0ae0d213-f58c-4ee5-844f-960b16a5a95b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:39:14.584379 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance c8aff61a-5f59-4f8c-8288-abd5a7853474 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:39:14.584527 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:39:14.584764 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance 3a56a898-691e-473e-a5c1-d618e861087b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:39:14.584882 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance b53c3532-08c2-4c05-b5e5-c217d3ef4d9a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:39:14.585201 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Total usable vcpus: 16, total allocated vcpus: 12 {{(pid=98967) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 26 10:39:14.585340 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Final resource view: name=np0000003731 phys_ram=64301MB used_ram=2816MB phys_disk=95GB used_disk=9GB total_vcpus=16 used_vcpus=12 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 10:39:12 up 28 min, 2 users, load average: 12.64, 6.96, 3.19\n', 'num_instances': '12', 'num_vm_active': '8', 'num_task_None': '9', 'num_os_type_None': '12', 'num_proj_49c2798faed447838b6c87f6d15cce66': '5', 'io_workload': '3', 'num_proj_58a58b94e5ec406182da9117e14aa789': '3', 'num_vm_rescued': '1', 'num_vm_building': '3', 'num_task_spawning': '2', 'num_proj_ed3cec81bee74bf3913ab4fcab11a000': '1', 'num_proj_ea834a26efe148649425d3e02d974ef4': '2', 'num_proj_13f2d75c17e64be5a0a5a2de4aaca2e7': '1', 'num_task_block_device_mapping': '1'} {{(pid=98967) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 26 10:39:14.591553 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-1f698fcd-77c1-4841-951e-e7b1703c6fc3 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "81a0f65d-2017-4275-aabe-88bc8c81225d" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 7.588s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:14.762919 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-095295f3-8742-4092-9a9b-3ba6ba1ae38a req-8a1a0855-4e19-482c-a108-d86f1759fb97 service nova] Releasing lock "refresh_cache-f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:39:14.768223 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Releasing lock "refresh_cache-b53c3532-08c2-4c05-b5e5-c217d3ef4d9a" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:39:14.768663 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Instance network_info: |[{"id": "43cc3477-2288-4c03-8374-5701e3d3baa1", "address": "fa:16:3e:0e:19:b0", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43cc3477-22", "ovs_interfaceid": "43cc3477-2288-4c03-8374-5701e3d3baa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 26 10:39:14.777207 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:39:14.777541 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] No BDM found with device name vdc, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:39:14.777637 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] No VIF found with MAC fa:16:3e:fd:10:20, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:39:14.777976 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] No VIF found with MAC fa:16:3e:ac:bc:0b, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:39:14.778692 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Using config drive Jun 26 10:39:14.869229 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Took 9.96 seconds to spawn the instance on the hypervisor. Jun 26 10:39:14.869795 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:14.902209 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] During sync_power_state the instance has a pending task (spawning). Skip. Jun 26 10:39:14.946307 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Calling os-brick to attach iSCSI Volume {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 26 10:39:14.946723 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:39:14.946905 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:14.947407 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:14.947767 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 10:39:14.962680 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:14.963164 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:14.963349 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:39:14.966695 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:14.967668 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:14.968439 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:39:14.981696 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:39:14.981696 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:14.991171 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:39:14.991171 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:15.000485 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d] added Jun 26 10:39:15.000485 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:39:15.000485 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:39:15.000485 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:39:15.000485 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:39:15.000485 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:39:15.000485 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:15.000807 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:39:15.000985 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0375(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:39:15.001237 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:39:15.006610 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d] added Jun 26 10:39:15.006610 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:39:15.006610 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:39:15.006610 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:39:15.006610 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:39:15.006610 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:39:15.006610 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:15.006914 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:39:15.007220 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0385(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:39:15.007220 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:39:15.289915 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:15.305426 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.79', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003731', 'execute': None}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:39:15.321647 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.scaleio [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98967) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 10:39:15.349251 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): nvme version {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:15.390476 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Took 15.94 seconds to build instance. Jun 26 10:39:15.395841 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:39:15.396123 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:39:15.399612 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] 'nvme version' failed. Not Retrying. {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 10:39:15.400408 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.nvmeof [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] nvme not present on system {{(pid=98967) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 10:39:15.410824 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98967) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 10:39:15.412823 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.lightos [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Current host hostNQN and IP(s) are ['10.4.3.79', 'fe80::f816:3eff:fe55:ba34', '192.168.40.6', 'fe80::f816:3eff:fe6b:fe1a', '192.168.50.6', 'fe80::f816:3eff:feca:9cd0', '192.168.10.6', 'fe80::f816:3eff:feb4:4e78', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f8bb:38ff:fe28:ff4a', 'fe80::fc16:3eff:fe37:b3f6', 'fe80::41a:feff:fe02:479d', 'fe80::fc16:3eff:fe5e:459', 'fe80::fc16:3eff:fe90:be9c', 'fe80::84cb:23ff:fe8e:e6e6', 'fe80::fc16:3eff:fe5a:811a', 'fe80::fc16:3eff:fe1b:5509', 'fe80::fc16:3eff:fe48:bca4', 'fe80::fc16:3eff:fef2:781c', 'fe80::b448:c6ff:fe9c:a1e9', 'fe80::fc16:3eff:fe78:446c', 'fe80::fc16:3eff:fe43:d828', 'fe80::fc16:3eff:fe9c:6906', 'fe80::bc5e:80ff:fe69:218d'] Jun 26 10:39:15.413300 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 10:39:15.413675 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] LIGHTOS: no hostnqn found. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 10:39:15.413991 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] <== get_connector_properties: return (105ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.79', 'host': 'np0000003731', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:2fddcc2116d6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '7f2a0776-2f14-4357-a22e-baa6677eb22e', 'nvme_native_multipath': False} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:39:15.414288 np0000003731 nova-compute[98967]: DEBUG nova.virt.block_device [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Updating existing volume attachment record: 2424ac2f-79f2-4a0b-bbdc-ce1c7ad3cdb1 {{(pid=98967) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 26 10:39:15.894678 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40028b44-e8b2-4c1a-b265-0d281bffaab7 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "3a56a898-691e-473e-a5c1-d618e861087b" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 17.450s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:15.901951 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:39:16.002361 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:39:16.012093 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.40.100 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:39:16.025140 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.50.100 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:39:16.032777 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:16.043583 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:16.050283 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:16.052794 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:16.074046 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:16.074046 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:16.074046 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:16.074046 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:16.074046 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:16.074046 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:16.074046 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:16.074046 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:16.074046 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:16.074046 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:16.074046 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:16.074046 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:16.074046 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:16.074046 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:16.074046 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:16.074046 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:16.074046 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:16.074046 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:16.074781 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:16.074781 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:16.074781 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:16.074781 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:16.074781 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:16.074781 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:16.074781 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:16.074781 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:16.074781 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:16.074781 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:16.074781 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:16.074781 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:16.074781 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:16.074781 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:16.074781 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:16.074781 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:16.074781 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:16.074781 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:16.130351 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d, portal: 192.168.50.100,3260] Jun 26 10:39:16.130351 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d, portal: 192.168.50.100,3260] successful. Jun 26 10:39:16.130351 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:16.137335 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d, portal: 192.168.40.100,3260] Jun 26 10:39:16.137335 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d, portal: 192.168.40.100,3260] successful. Jun 26 10:39:16.137335 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:16.147135 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:16.153650 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Creating config drive at /opt/stack/data/nova/instances/ee4d14ad-8bd2-4b8b-9526-51abafe757f2/disk.config Jun 26 10:39:16.164231 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:16.166083 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ee4d14ad-8bd2-4b8b-9526-51abafe757f2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnolkeqxh {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:16.186743 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:16.186743 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:16.186743 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:16.186743 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:16.186743 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:16.186743 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:16.186743 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:16.186743 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:16.186743 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:16.186743 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:16.186743 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:16.190227 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:16.190227 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:16.190227 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:16.190227 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:16.190227 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:16.190227 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:16.190227 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:16.190227 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:16.190227 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:16.190227 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:16.190227 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:16.190227 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:16.190227 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:16.190227 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:16.190227 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:16.190227 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:16.190227 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:16.190227 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:16.190227 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:16.190227 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:16.190227 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:16.190227 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:16.191283 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:16.191283 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:16.191283 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:16.191283 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:16.191283 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:16.191283 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:16.191283 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:16.191283 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:16.191283 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:16.191283 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:16.191283 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:16.192092 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.223s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:39:16.193870 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.229s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:39:16.194343 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Connected to 192.168.50.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:39:16.195417 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Connected to 192.168.40.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:39:16.197059 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] HCTL ('15', '-', '-', 0) found on session 28 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:39:16.197264 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Scanning host 15 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:39:16.198602 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] HCTL ('16', '-', '-', 0) found on session 29 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:39:16.198740 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Scanning host 16 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:39:16.240793 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Searching for a device in session 28 and hctl ['15', '*', '*', 0] yield: None {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:39:16.240793 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Searching for a device in session 29 and hctl ['16', '*', '*', 0] yield: None {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:39:16.240793 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ee4d14ad-8bd2-4b8b-9526-51abafe757f2/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpnolkeqxh" returned: 0 in 0.069s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:16.422033 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Compute_service record updated for np0000003731:np0000003731 {{(pid=98967) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 26 10:39:16.422033 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 2.926s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:16.425646 np0000003731 nova-compute[98967]: DEBUG oslo.service.backend._threading.loopingcall [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.48 seconds {{(pid=98967) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 26 10:39:16.845645 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:16.901990 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:39:16.902487 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:39:16.905449 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:39:16.906204 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:39:16.906447 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:39:16.906717 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:39:16.906981 np0000003731 nova-compute[98967]: DEBUG oslo.service.backend._threading.loopingcall [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 50.21 seconds {{(pid=98967) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 26 10:39:16.918455 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:16.931325 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:16.981890 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:17.140237 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:17.147992 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:17.167267 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:17.191765 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:17.225967 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Searching for a device in session 28 and hctl ['15', '*', '*', 0] yield: sdj {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:39:17.227962 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:39:17.230918 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Searching for a device in session 29 and hctl ['16', '*', '*', 0] yield: sdk {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:39:17.231018 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:39:17.317513 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:17.374623 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:17.380444 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:17.424768 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:17.443154 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-9266df56-a3f7-4f73-9c0c-823905f52348 req-1796e3cd-7f38-4d2b-97c5-1fb639ed18a9 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-plugged-49031ae0-122b-4f20-8d73-20048a6ad965 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:17.443483 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-9266df56-a3f7-4f73-9c0c-823905f52348 req-1796e3cd-7f38-4d2b-97c5-1fb639ed18a9 service nova] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:17.443719 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-9266df56-a3f7-4f73-9c0c-823905f52348 req-1796e3cd-7f38-4d2b-97c5-1fb639ed18a9 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:17.443861 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-9266df56-a3f7-4f73-9c0c-823905f52348 req-1796e3cd-7f38-4d2b-97c5-1fb639ed18a9 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:17.444105 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-9266df56-a3f7-4f73-9c0c-823905f52348 req-1796e3cd-7f38-4d2b-97c5-1fb639ed18a9 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Processing event network-vif-plugged-49031ae0-122b-4f20-8d73-20048a6ad965 {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:39:17.453655 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:17.459162 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:17.498492 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:17.540748 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:17.546405 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:17.593111 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Start spawning the instance on the hypervisor. {{(pid=98967) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 26 10:39:17.595081 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Creating instance directory {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 26 10:39:17.595653 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Creating image(s) Jun 26 10:39:17.596205 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Did not create local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 26 10:39:17.596322 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Ensure instance console log exists: /opt/stack/data/nova/instances/b53c3532-08c2-4c05-b5e5-c217d3ef4d9a/console.log {{(pid=98967) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 26 10:39:17.596643 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:17.596814 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:17.596985 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:17.597641 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Start _get_guest_xml network_info=[{"id": "43cc3477-2288-4c03-8374-5701e3d3baa1", "address": "fa:16:3e:0e:19:b0", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43cc3477-22", "ovs_interfaceid": "43cc3477-2288-4c03-8374-5701e3d3baa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc71798f-22b5-44d3-8fac-77084df22f84', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': 'b53c3532-08c2-4c05-b5e5-c217d3ef4d9a', 'attached_at': '', 'detached_at': '', 'volume_id': 'dc71798f-22b5-44d3-8fac-77084df22f84', 'serial': 'dc71798f-22b5-44d3-8fac-77084df22f84'}, 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '2424ac2f-79f2-4a0b-bbdc-ce1c7ad3cdb1', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:39:17.611037 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:39:17.611938 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1292545386', uuid='b53c3532-08c2-4c05-b5e5-c217d3ef4d9a'), owner=OwnerMeta(userid='72704c563abb412aa2c238092bd55ec4', username='tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member', projectid='ea834a26efe148649425d3e02d974ef4', projectname='tempest-ServerBootFromVolumeStableRescueTest-618712607'), image=ImageMeta(id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "43cc3477-2288-4c03-8374-5701e3d3baa1", "address": "fa:16:3e:0e:19:b0", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43cc3477-22", "ovs_interfaceid": "43cc3477-2288-4c03-8374-5701e3d3baa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470357.6114645) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:39:17.615020 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:39:17.615828 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:39:17.625041 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:39:17.625172 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:39:17.626741 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:39:17.627175 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:39:17.627525 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:39:17.627525 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:39:17.627776 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:39:17.628865 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:39:17.628865 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:39:17.630233 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:39:17.630422 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:39:17.631916 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:39:17.632433 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:39:17.632706 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:39:17.652768 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:17.661606 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Calling os-brick to attach iSCSI Volume {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 26 10:39:17.661606 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc71798f-22b5-44d3-8fac-77084df22f84', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:39:17.661858 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:17.663763 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:17.754523 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:17.797399 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:17.838248 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:17.962049 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:17.968588 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 26 10:39:18.147994 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:18.152658 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:18.175620 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:18.177606 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:18.200415 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:18.499431 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:18.502168 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:18.583017 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-c1c768e4-28ff-40ab-9b65-c65c512f6b9c req-488d1582-d242-45c7-b751-1709d91e92ad service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-plugged-c2ff0bc1-8b84-4517-b347-f78bb6a9e14c {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:18.583692 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c1c768e4-28ff-40ab-9b65-c65c512f6b9c req-488d1582-d242-45c7-b751-1709d91e92ad service nova] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:18.583826 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c1c768e4-28ff-40ab-9b65-c65c512f6b9c req-488d1582-d242-45c7-b751-1709d91e92ad service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:18.583941 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c1c768e4-28ff-40ab-9b65-c65c512f6b9c req-488d1582-d242-45c7-b751-1709d91e92ad service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:18.584128 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-c1c768e4-28ff-40ab-9b65-c65c512f6b9c req-488d1582-d242-45c7-b751-1709d91e92ad service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Processing event network-vif-plugged-c2ff0bc1-8b84-4517-b347-f78bb6a9e14c {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:39:18.716408 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:18.718658 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:18.940419 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:18.940419 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:18.991560 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Found WWN 3300000008cbe0377 for multipath device dm-8 {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 26 10:39:18.991560 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.044s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:39:18.991560 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] <== connect_volume: return (4044ms) {'type': 'block', 'scsi_wwn': '3300000008cbe0377', 'path': '/dev/dm-8', 'multipath_id': '3300000008cbe0377'} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:39:18.991560 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008cbe0377', 'path': '/dev/dm-8', 'multipath_id': '3300000008cbe0377'} {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 26 10:39:18.992362 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.330s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:18.994443 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc71798f-22b5-44d3-8fac-77084df22f84', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 10:39:19.000797 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lazy-loading 'flavor' on Instance uuid c1043abd-b0c0-439e-b065-8bef627483cb {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:19.013042 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:19.013717 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:19.013864 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:39:19.015271 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:19.015871 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:19.016211 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:39:19.018698 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:39:19.018892 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] VM Started (Lifecycle Event) Jun 26 10:39:19.034167 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:39:19.034167 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:19.035551 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:39:19.035551 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:19.055805 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84] added Jun 26 10:39:19.055805 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:39:19.055805 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:39:19.055805 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:39:19.055805 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:39:19.055805 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:39:19.055805 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:19.056229 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:39:19.056229 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0423(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:39:19.056524 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:39:19.063178 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84] added Jun 26 10:39:19.063178 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:39:19.063178 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:39:19.063178 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:39:19.063178 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:39:19.063178 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:39:19.063178 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:19.063823 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:39:19.063823 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0475(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:39:19.063823 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:39:19.409622 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:19.416395 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:19.427672 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:19.428986 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:19.456243 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:19.507393 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Attempting to attach volume 1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98967) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 26 10:39:19.508886 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] attach device xml: Jun 26 10:39:19.508886 np0000003731 nova-compute[98967]: Jun 26 10:39:19.508886 np0000003731 nova-compute[98967]: Jun 26 10:39:19.508886 np0000003731 nova-compute[98967]: Jun 26 10:39:19.508886 np0000003731 nova-compute[98967]: Jun 26 10:39:19.508886 np0000003731 nova-compute[98967]: 1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d Jun 26 10:39:19.508886 np0000003731 nova-compute[98967]: Jun 26 10:39:19.508886 np0000003731 nova-compute[98967]: Jun 26 10:39:19.508886 np0000003731 nova-compute[98967]: {{(pid=98967) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 26 10:39:19.526078 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:19.531593 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Paused> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:39:19.531788 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] VM Paused (Lifecycle Event) Jun 26 10:39:19.599872 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-c375625e-0f69-4696-8046-8bf2ed1dd979 req-3c1dac90-54ed-48a5-90a6-1ae7b8cbe07c service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-plugged-49031ae0-122b-4f20-8d73-20048a6ad965 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:19.600148 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c375625e-0f69-4696-8046-8bf2ed1dd979 req-3c1dac90-54ed-48a5-90a6-1ae7b8cbe07c service nova] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:19.600388 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c375625e-0f69-4696-8046-8bf2ed1dd979 req-3c1dac90-54ed-48a5-90a6-1ae7b8cbe07c service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:19.600562 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c375625e-0f69-4696-8046-8bf2ed1dd979 req-3c1dac90-54ed-48a5-90a6-1ae7b8cbe07c service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:19.600732 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-c375625e-0f69-4696-8046-8bf2ed1dd979 req-3c1dac90-54ed-48a5-90a6-1ae7b8cbe07c service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] No event matching network-vif-plugged-49031ae0-122b-4f20-8d73-20048a6ad965 in dict_keys([('network-vif-plugged', 'ebb9bc95-98ee-43f1-bd95-8a3da5497c72'), ('network-vif-plugged', 'dcce8bc4-9171-4ef4-b762-37d89aea863b'), ('network-vif-plugged', '9882d815-8273-4eb8-937b-a1c1e4af4018'), ('network-vif-plugged', '8d782392-1caa-4b0a-b7e2-58c03357a004'), ('network-vif-plugged', '45a4f3f8-69ee-4cc0-811e-a1178c8b18f2')]) {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 26 10:39:19.600946 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-c375625e-0f69-4696-8046-8bf2ed1dd979 req-3c1dac90-54ed-48a5-90a6-1ae7b8cbe07c service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received unexpected event network-vif-plugged-49031ae0-122b-4f20-8d73-20048a6ad965 for instance with vm_state building and task_state spawning. Jun 26 10:39:19.600993 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-c375625e-0f69-4696-8046-8bf2ed1dd979 req-3c1dac90-54ed-48a5-90a6-1ae7b8cbe07c service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-plugged-dcce8bc4-9171-4ef4-b762-37d89aea863b {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:19.601390 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c375625e-0f69-4696-8046-8bf2ed1dd979 req-3c1dac90-54ed-48a5-90a6-1ae7b8cbe07c service nova] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:19.601591 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c375625e-0f69-4696-8046-8bf2ed1dd979 req-3c1dac90-54ed-48a5-90a6-1ae7b8cbe07c service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:19.602037 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c375625e-0f69-4696-8046-8bf2ed1dd979 req-3c1dac90-54ed-48a5-90a6-1ae7b8cbe07c service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:19.602220 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-c375625e-0f69-4696-8046-8bf2ed1dd979 req-3c1dac90-54ed-48a5-90a6-1ae7b8cbe07c service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Processing event network-vif-plugged-dcce8bc4-9171-4ef4-b762-37d89aea863b {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:39:19.602409 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-c375625e-0f69-4696-8046-8bf2ed1dd979 req-3c1dac90-54ed-48a5-90a6-1ae7b8cbe07c service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-plugged-dcce8bc4-9171-4ef4-b762-37d89aea863b {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:19.602586 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c375625e-0f69-4696-8046-8bf2ed1dd979 req-3c1dac90-54ed-48a5-90a6-1ae7b8cbe07c service nova] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:19.602988 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c375625e-0f69-4696-8046-8bf2ed1dd979 req-3c1dac90-54ed-48a5-90a6-1ae7b8cbe07c service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:19.602988 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c375625e-0f69-4696-8046-8bf2ed1dd979 req-3c1dac90-54ed-48a5-90a6-1ae7b8cbe07c service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:19.602988 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-c375625e-0f69-4696-8046-8bf2ed1dd979 req-3c1dac90-54ed-48a5-90a6-1ae7b8cbe07c service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] No event matching network-vif-plugged-dcce8bc4-9171-4ef4-b762-37d89aea863b in dict_keys([('network-vif-plugged', 'ebb9bc95-98ee-43f1-bd95-8a3da5497c72'), ('network-vif-plugged', '9882d815-8273-4eb8-937b-a1c1e4af4018'), ('network-vif-plugged', '8d782392-1caa-4b0a-b7e2-58c03357a004'), ('network-vif-plugged', '45a4f3f8-69ee-4cc0-811e-a1178c8b18f2')]) {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 26 10:39:19.603331 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-c375625e-0f69-4696-8046-8bf2ed1dd979 req-3c1dac90-54ed-48a5-90a6-1ae7b8cbe07c service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received unexpected event network-vif-plugged-dcce8bc4-9171-4ef4-b762-37d89aea863b for instance with vm_state building and task_state spawning. Jun 26 10:39:19.603331 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-c375625e-0f69-4696-8046-8bf2ed1dd979 req-3c1dac90-54ed-48a5-90a6-1ae7b8cbe07c service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-plugged-9882d815-8273-4eb8-937b-a1c1e4af4018 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:19.603425 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c375625e-0f69-4696-8046-8bf2ed1dd979 req-3c1dac90-54ed-48a5-90a6-1ae7b8cbe07c service nova] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:19.603630 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c375625e-0f69-4696-8046-8bf2ed1dd979 req-3c1dac90-54ed-48a5-90a6-1ae7b8cbe07c service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:19.603709 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c375625e-0f69-4696-8046-8bf2ed1dd979 req-3c1dac90-54ed-48a5-90a6-1ae7b8cbe07c service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:19.603840 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-c375625e-0f69-4696-8046-8bf2ed1dd979 req-3c1dac90-54ed-48a5-90a6-1ae7b8cbe07c service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Processing event network-vif-plugged-9882d815-8273-4eb8-937b-a1c1e4af4018 {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:39:19.702263 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:19.837865 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "edf92675-15b4-424f-85b5-80341e77b578" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:19.838123 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "edf92675-15b4-424f-85b5-80341e77b578" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:19.930757 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:19.938254 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Acquiring lock "3dd6ac52-de12-47da-bc90-77d0fff44acf" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:19.938737 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lock "3dd6ac52-de12-47da-bc90-77d0fff44acf" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:20.036124 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:20.038528 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Synchronizing instance power state after lifecycle event "Paused"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 3 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:39:20.059026 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:39:20.064306 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.40.100 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:39:20.077975 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.50.100 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:39:20.087808 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:20.097224 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:20.104480 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:20.119889 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:20.119889 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:20.119889 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:20.119889 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:20.119889 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:20.119889 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:20.119889 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:20.119889 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:20.119889 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:20.119889 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:20.119889 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:20.119889 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:20.119889 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:20.119889 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:20.119889 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:20.119889 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:20.119889 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:20.119889 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:20.119889 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:20.119889 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:20.119889 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:20.119889 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:20.127748 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:20.127748 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:20.127748 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:20.127748 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:20.127748 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:20.127748 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:20.127748 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:20.127748 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:20.127748 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:20.127748 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:20.127748 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:20.129743 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:20.129743 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:20.129743 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:20.129743 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:20.129743 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:20.129743 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:20.129743 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:20.129743 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:20.129743 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:20.129743 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:20.129743 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:20.157486 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-0accd09e-df34-46e1-ac66-57f90a34b68d req-46f59c01-26bc-43eb-9617-d72deff70e42 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-plugged-ebb9bc95-98ee-43f1-bd95-8a3da5497c72 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:20.158026 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-0accd09e-df34-46e1-ac66-57f90a34b68d req-46f59c01-26bc-43eb-9617-d72deff70e42 service nova] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:20.158026 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-0accd09e-df34-46e1-ac66-57f90a34b68d req-46f59c01-26bc-43eb-9617-d72deff70e42 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:20.159203 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-0accd09e-df34-46e1-ac66-57f90a34b68d req-46f59c01-26bc-43eb-9617-d72deff70e42 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:20.159398 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-0accd09e-df34-46e1-ac66-57f90a34b68d req-46f59c01-26bc-43eb-9617-d72deff70e42 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Processing event network-vif-plugged-ebb9bc95-98ee-43f1-bd95-8a3da5497c72 {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:39:20.176210 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84, portal: 192.168.40.100,3260] Jun 26 10:39:20.176210 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84, portal: 192.168.40.100,3260] successful. Jun 26 10:39:20.176210 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:20.187753 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84, portal: 192.168.50.100,3260] Jun 26 10:39:20.187753 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84, portal: 192.168.50.100,3260] successful. Jun 26 10:39:20.187753 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:20.193170 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:20.209346 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:20.221818 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:20.221818 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:20.221818 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:20.221818 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:20.221818 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:20.221818 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:20.221818 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:20.221818 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:20.221818 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:20.221818 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:20.221818 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:20.221818 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:20.221818 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:20.221818 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:20.221818 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:20.221818 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:20.221818 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:20.221818 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:20.221818 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:20.221818 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:20.221818 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:20.221818 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:20.221818 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:20.221818 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:20.221818 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:20.221818 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:20.222638 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.209s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:39:20.222638 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Connected to 192.168.40.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:39:20.225579 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] HCTL ('17', '-', '-', 0) found on session 30 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:39:20.225727 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Scanning host 17 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:39:20.233883 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:20.233883 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:20.233883 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:20.233883 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:20.233883 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:20.233883 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:20.233883 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:20.233883 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:20.233883 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:20.233883 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:20.233883 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:20.233883 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:20.233883 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:20.234350 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:20.234350 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:20.234350 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:20.234350 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:20.234350 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:20.234350 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:20.234350 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:20.234350 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:20.234350 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:20.234350 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:20.234350 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:20.234350 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:20.234350 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:20.235152 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.219s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:39:20.235347 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Connected to 192.168.50.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:39:20.237178 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] HCTL ('18', '-', '-', 0) found on session 31 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:39:20.237350 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Scanning host 18 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:39:20.247222 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Searching for a device in session 30 and hctl ['17', '*', '*', 0] yield: sdl {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:39:20.247222 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc71798f-22b5-44d3-8fac-77084df22f84', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:39:20.259938 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Searching for a device in session 31 and hctl ['18', '*', '*', 0] yield: sdm {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:39:20.260089 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'dc71798f-22b5-44d3-8fac-77084df22f84', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:39:20.340254 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Starting instance... {{(pid=98967) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 26 10:39:20.445738 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Starting instance... {{(pid=98967) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 26 10:39:20.543751 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] During sync_power_state the instance has a pending task (spawning). Skip. Jun 26 10:39:20.699592 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-f352d86a-f9d6-4cf5-b89b-a1a60937394b req-60b99c16-d02c-45c9-af13-e3c251691062 service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Received event network-changed-fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:20.701317 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-f352d86a-f9d6-4cf5-b89b-a1a60937394b req-60b99c16-d02c-45c9-af13-e3c251691062 service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Refreshing instance network info cache due to event network-changed-fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:39:20.701626 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-f352d86a-f9d6-4cf5-b89b-a1a60937394b req-60b99c16-d02c-45c9-af13-e3c251691062 service nova] Acquiring lock "refresh_cache-3a56a898-691e-473e-a5c1-d618e861087b" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:39:20.702894 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-f352d86a-f9d6-4cf5-b89b-a1a60937394b req-60b99c16-d02c-45c9-af13-e3c251691062 service nova] Acquired lock "refresh_cache-3a56a898-691e-473e-a5c1-d618e861087b" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:39:20.702894 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-f352d86a-f9d6-4cf5-b89b-a1a60937394b req-60b99c16-d02c-45c9-af13-e3c251691062 service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Refreshing network info cache for port fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:39:20.906664 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:20.907054 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.002s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:20.913456 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98967) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 26 10:39:20.913456 np0000003731 nova-compute[98967]: INFO nova.compute.claims [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Claim successful on node np0000003731 Jun 26 10:39:21.012721 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:21.016723 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 26 10:39:21.204656 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-f352d86a-f9d6-4cf5-b89b-a1a60937394b req-60b99c16-d02c-45c9-af13-e3c251691062 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:21.220703 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:39:21.220878 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:39:21.221077 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:39:21.221347 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No VIF found with MAC fa:16:3e:48:bc:a4, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:39:21.604275 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-f352d86a-f9d6-4cf5-b89b-a1a60937394b req-60b99c16-d02c-45c9-af13-e3c251691062 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:21.686711 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-6399b981-f2ae-47bc-9ef2-d498b25fb90c req-53703b10-f9ab-4e29-ae30-e677a1231579 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-plugged-9882d815-8273-4eb8-937b-a1c1e4af4018 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:21.686711 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-6399b981-f2ae-47bc-9ef2-d498b25fb90c req-53703b10-f9ab-4e29-ae30-e677a1231579 service nova] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:21.686711 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-6399b981-f2ae-47bc-9ef2-d498b25fb90c req-53703b10-f9ab-4e29-ae30-e677a1231579 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:21.686711 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-6399b981-f2ae-47bc-9ef2-d498b25fb90c req-53703b10-f9ab-4e29-ae30-e677a1231579 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:21.686711 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-6399b981-f2ae-47bc-9ef2-d498b25fb90c req-53703b10-f9ab-4e29-ae30-e677a1231579 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] No event matching network-vif-plugged-9882d815-8273-4eb8-937b-a1c1e4af4018 in dict_keys([('network-vif-plugged', '8d782392-1caa-4b0a-b7e2-58c03357a004'), ('network-vif-plugged', '45a4f3f8-69ee-4cc0-811e-a1178c8b18f2')]) {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 26 10:39:21.686711 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-6399b981-f2ae-47bc-9ef2-d498b25fb90c req-53703b10-f9ab-4e29-ae30-e677a1231579 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received unexpected event network-vif-plugged-9882d815-8273-4eb8-937b-a1c1e4af4018 for instance with vm_state building and task_state spawning. Jun 26 10:39:21.823541 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-f352d86a-f9d6-4cf5-b89b-a1a60937394b req-60b99c16-d02c-45c9-af13-e3c251691062 service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Updated VIF entry in instance network info cache for port fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:39:21.823863 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-f352d86a-f9d6-4cf5-b89b-a1a60937394b req-60b99c16-d02c-45c9-af13-e3c251691062 service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Updating instance_info_cache with network_info: [{"id": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "address": "fa:16:3e:9c:69:06", "network": {"id": "745fd3f4-1b5b-4135-add5-62d583152edb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1747333964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13f2d75c17e64be5a0a5a2de4aaca2e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f36cb-f5", "ovs_interfaceid": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:39:22.016669 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:22.043156 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Found WWN 33000000081e8b8cb for multipath device dm-9 {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 26 10:39:22.043156 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.048s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:39:22.043156 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] <== connect_volume: return (4379ms) {'type': 'block', 'scsi_wwn': '33000000081e8b8cb', 'path': '/dev/dm-9', 'multipath_id': '33000000081e8b8cb'} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:39:22.043156 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000081e8b8cb', 'path': '/dev/dm-9', 'multipath_id': '33000000081e8b8cb'} {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 26 10:39:22.241957 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-50e44787-9cec-4193-8152-5bbdd1439467 req-bd3087a3-11e1-42a6-9238-62c7c73c9112 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-plugged-ebb9bc95-98ee-43f1-bd95-8a3da5497c72 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:22.242261 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-50e44787-9cec-4193-8152-5bbdd1439467 req-bd3087a3-11e1-42a6-9238-62c7c73c9112 service nova] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:22.242487 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-50e44787-9cec-4193-8152-5bbdd1439467 req-bd3087a3-11e1-42a6-9238-62c7c73c9112 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:22.243420 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-50e44787-9cec-4193-8152-5bbdd1439467 req-bd3087a3-11e1-42a6-9238-62c7c73c9112 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:22.243595 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-50e44787-9cec-4193-8152-5bbdd1439467 req-bd3087a3-11e1-42a6-9238-62c7c73c9112 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] No event matching network-vif-plugged-ebb9bc95-98ee-43f1-bd95-8a3da5497c72 in dict_keys([('network-vif-plugged', '8d782392-1caa-4b0a-b7e2-58c03357a004'), ('network-vif-plugged', '45a4f3f8-69ee-4cc0-811e-a1178c8b18f2')]) {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 26 10:39:22.243788 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-50e44787-9cec-4193-8152-5bbdd1439467 req-bd3087a3-11e1-42a6-9238-62c7c73c9112 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received unexpected event network-vif-plugged-ebb9bc95-98ee-43f1-bd95-8a3da5497c72 for instance with vm_state building and task_state spawning. Jun 26 10:39:22.244036 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-50e44787-9cec-4193-8152-5bbdd1439467 req-bd3087a3-11e1-42a6-9238-62c7c73c9112 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-plugged-8d782392-1caa-4b0a-b7e2-58c03357a004 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:22.244036 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-50e44787-9cec-4193-8152-5bbdd1439467 req-bd3087a3-11e1-42a6-9238-62c7c73c9112 service nova] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:22.244221 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-50e44787-9cec-4193-8152-5bbdd1439467 req-bd3087a3-11e1-42a6-9238-62c7c73c9112 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:22.244371 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-50e44787-9cec-4193-8152-5bbdd1439467 req-bd3087a3-11e1-42a6-9238-62c7c73c9112 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:22.244534 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-50e44787-9cec-4193-8152-5bbdd1439467 req-bd3087a3-11e1-42a6-9238-62c7c73c9112 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Processing event network-vif-plugged-8d782392-1caa-4b0a-b7e2-58c03357a004 {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:39:22.244698 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-50e44787-9cec-4193-8152-5bbdd1439467 req-bd3087a3-11e1-42a6-9238-62c7c73c9112 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-plugged-8d782392-1caa-4b0a-b7e2-58c03357a004 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:22.244849 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-50e44787-9cec-4193-8152-5bbdd1439467 req-bd3087a3-11e1-42a6-9238-62c7c73c9112 service nova] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:22.245030 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-50e44787-9cec-4193-8152-5bbdd1439467 req-bd3087a3-11e1-42a6-9238-62c7c73c9112 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:22.245179 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-50e44787-9cec-4193-8152-5bbdd1439467 req-bd3087a3-11e1-42a6-9238-62c7c73c9112 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:22.245410 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-50e44787-9cec-4193-8152-5bbdd1439467 req-bd3087a3-11e1-42a6-9238-62c7c73c9112 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] No event matching network-vif-plugged-8d782392-1caa-4b0a-b7e2-58c03357a004 in dict_keys([('network-vif-plugged', '45a4f3f8-69ee-4cc0-811e-a1178c8b18f2')]) {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:348}} Jun 26 10:39:22.245579 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-50e44787-9cec-4193-8152-5bbdd1439467 req-bd3087a3-11e1-42a6-9238-62c7c73c9112 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received unexpected event network-vif-plugged-8d782392-1caa-4b0a-b7e2-58c03357a004 for instance with vm_state building and task_state spawning. Jun 26 10:39:22.245731 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-50e44787-9cec-4193-8152-5bbdd1439467 req-bd3087a3-11e1-42a6-9238-62c7c73c9112 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-plugged-45a4f3f8-69ee-4cc0-811e-a1178c8b18f2 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:22.245893 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-50e44787-9cec-4193-8152-5bbdd1439467 req-bd3087a3-11e1-42a6-9238-62c7c73c9112 service nova] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:22.246219 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-50e44787-9cec-4193-8152-5bbdd1439467 req-bd3087a3-11e1-42a6-9238-62c7c73c9112 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:22.246443 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-50e44787-9cec-4193-8152-5bbdd1439467 req-bd3087a3-11e1-42a6-9238-62c7c73c9112 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:22.247608 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-50e44787-9cec-4193-8152-5bbdd1439467 req-bd3087a3-11e1-42a6-9238-62c7c73c9112 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Processing event network-vif-plugged-45a4f3f8-69ee-4cc0-811e-a1178c8b18f2 {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:39:22.247863 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-50e44787-9cec-4193-8152-5bbdd1439467 req-bd3087a3-11e1-42a6-9238-62c7c73c9112 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-plugged-45a4f3f8-69ee-4cc0-811e-a1178c8b18f2 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:22.248513 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Instance event wait completed in 3 seconds for network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged,network-vif-plugged {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:39:22.248779 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-50e44787-9cec-4193-8152-5bbdd1439467 req-bd3087a3-11e1-42a6-9238-62c7c73c9112 service nova] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:22.249374 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-50e44787-9cec-4193-8152-5bbdd1439467 req-bd3087a3-11e1-42a6-9238-62c7c73c9112 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:22.249691 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-50e44787-9cec-4193-8152-5bbdd1439467 req-bd3087a3-11e1-42a6-9238-62c7c73c9112 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:22.249802 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-50e44787-9cec-4193-8152-5bbdd1439467 req-bd3087a3-11e1-42a6-9238-62c7c73c9112 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] No waiting events found dispatching network-vif-plugged-45a4f3f8-69ee-4cc0-811e-a1178c8b18f2 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:39:22.249959 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-50e44787-9cec-4193-8152-5bbdd1439467 req-bd3087a3-11e1-42a6-9238-62c7c73c9112 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received unexpected event network-vif-plugged-45a4f3f8-69ee-4cc0-811e-a1178c8b18f2 for instance with vm_state building and task_state spawning. Jun 26 10:39:22.251765 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:39:22.252485 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] VM Resumed (Lifecycle Event) Jun 26 10:39:22.253546 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Guest created on hypervisor {{(pid=98967) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 26 10:39:22.255740 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Instance spawned successfully. Jun 26 10:39:22.256121 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 26 10:39:22.328656 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-f352d86a-f9d6-4cf5-b89b-a1a60937394b req-60b99c16-d02c-45c9-af13-e3c251691062 service nova] Releasing lock "refresh_cache-3a56a898-691e-473e-a5c1-d618e861087b" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:39:22.329063 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-f352d86a-f9d6-4cf5-b89b-a1a60937394b req-60b99c16-d02c-45c9-af13-e3c251691062 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-plugged-c2ff0bc1-8b84-4517-b347-f78bb6a9e14c {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:22.329268 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-f352d86a-f9d6-4cf5-b89b-a1a60937394b req-60b99c16-d02c-45c9-af13-e3c251691062 service nova] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:22.329502 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-f352d86a-f9d6-4cf5-b89b-a1a60937394b req-60b99c16-d02c-45c9-af13-e3c251691062 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:22.329719 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-f352d86a-f9d6-4cf5-b89b-a1a60937394b req-60b99c16-d02c-45c9-af13-e3c251691062 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:22.329833 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-f352d86a-f9d6-4cf5-b89b-a1a60937394b req-60b99c16-d02c-45c9-af13-e3c251691062 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] No waiting events found dispatching network-vif-plugged-c2ff0bc1-8b84-4517-b347-f78bb6a9e14c {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:39:22.330078 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-f352d86a-f9d6-4cf5-b89b-a1a60937394b req-60b99c16-d02c-45c9-af13-e3c251691062 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received unexpected event network-vif-plugged-c2ff0bc1-8b84-4517-b347-f78bb6a9e14c for instance with vm_state building and task_state spawning. Jun 26 10:39:22.499486 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:22.550878 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:39:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1292545386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-serverbootfromvolumestablerescuetest-server-1292545386',id=20,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea834a26efe148649425d3e02d974ef4',ramdisk_id='',reservation_id='r-j2neevza',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-618712607',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:39:11Z,user_data=None,user_id='72704c563abb412aa2c238092bd55ec4',uuid=b53c3532-08c2-4c05-b5e5-c217d3ef4d9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43cc3477-2288-4c03-8374-5701e3d3baa1", "address": "fa:16:3e:0e:19:b0", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43cc3477-22", "ovs_interfaceid": "43cc3477-2288-4c03-8374-5701e3d3baa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:39:22.551175 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Converting VIF {"id": "43cc3477-2288-4c03-8374-5701e3d3baa1", "address": "fa:16:3e:0e:19:b0", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43cc3477-22", "ovs_interfaceid": "43cc3477-2288-4c03-8374-5701e3d3baa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:39:22.551948 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:19:b0,bridge_name='br-int',has_traffic_filtering=True,id=43cc3477-2288-4c03-8374-5701e3d3baa1,network=Network(67c50821-8012-4a48-8c3a-b0cc3d2ddcb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43cc3477-22') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:39:22.552838 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lazy-loading 'pci_devices' on Instance uuid b53c3532-08c2-4c05-b5e5-c217d3ef4d9a {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:22.637265 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:22.637478 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:22.756175 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:22.762631 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:39:22.769446 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Found default for hw_cdrom_bus of ide {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:22.769805 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Found default for hw_disk_bus of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:22.770317 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Found default for hw_input_bus of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:22.771324 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Found default for hw_pointer_model of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:22.771933 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Found default for hw_video_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:22.773104 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Found default for hw_vif_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:22.786762 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:39:22.787074 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:39:22.801589 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c57b8d51-6431-4307-a681-2f46f7e4596e tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "c1043abd-b0c0-439e-b065-8bef627483cb" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 8.655s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:22.855168 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0005997939999815571 future=) submitted to {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:39:22.855654 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] Emitting event Stopped> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:39:22.855926 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:39:22.856235 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] VM Stopped (Lifecycle Event) Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] End _get_guest_xml xml= Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: instance-00000014 Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: 196608 Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: tempest-ServerBootFromVolumeStableRescueTest-server-1292545386 Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: 2026-06-26 10:39:17 Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: 192 Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: 0 Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: 0 Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: True Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: bare Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: 0 Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: virtio Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: tempest-ServerBootFromVolumeStableRescueTest-618712607 Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: hvm Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: 128 Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: dc71798f-22b5-44d3-8fac-77084df22f84 Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Preparing to wait for external event network-vif-plugged-43cc3477-2288-4c03-8374-5701e3d3baa1 {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:23.060380 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:39:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1292545386',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-serverbootfromvolumestablerescuetest-server-1292545386',id=20,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea834a26efe148649425d3e02d974ef4',ramdisk_id='',reservation_id='r-j2neevza',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-618712607',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:39:11Z,user_data=None,user_id='72704c563abb412aa2c238092bd55ec4',uuid=b53c3532-08c2-4c05-b5e5-c217d3ef4d9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "43cc3477-2288-4c03-8374-5701e3d3baa1", "address": "fa:16:3e:0e:19:b0", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43cc3477-22", "ovs_interfaceid": "43cc3477-2288-4c03-8374-5701e3d3baa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:39:23.065770 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Converting VIF {"id": "43cc3477-2288-4c03-8374-5701e3d3baa1", "address": "fa:16:3e:0e:19:b0", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43cc3477-22", "ovs_interfaceid": "43cc3477-2288-4c03-8374-5701e3d3baa1", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:39:23.067418 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:0e:19:b0,bridge_name='br-int',has_traffic_filtering=True,id=43cc3477-2288-4c03-8374-5701e3d3baa1,network=Network(67c50821-8012-4a48-8c3a-b0cc3d2ddcb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43cc3477-22') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:39:23.067418 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:19:b0,bridge_name='br-int',has_traffic_filtering=True,id=43cc3477-2288-4c03-8374-5701e3d3baa1,network=Network(67c50821-8012-4a48-8c3a-b0cc3d2ddcb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43cc3477-22') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:39:23.068107 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:23.068537 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:23.068887 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:39:23.071342 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:23.071619 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'e80f3172-f8b0-53a2-9136-62b21a3d36d1', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:23.073627 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:23.074805 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:39:23.081914 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:23.082223 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap43cc3477-22, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:23.082878 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap43cc3477-22, col_values=(('qos', UUID('b16e2fab-8c66-45f2-a961-0da1052f8f32')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:23.083894 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap43cc3477-22, col_values=(('external_ids', {'iface-id': '43cc3477-2288-4c03-8374-5701e3d3baa1', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:0e:19:b0', 'vm-uuid': 'b53c3532-08c2-4c05-b5e5-c217d3ef4d9a'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:23.085290 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:23.086849 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:39:23.093290 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:23.095392 np0000003731 nova-compute[98967]: INFO os_vif [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:0e:19:b0,bridge_name='br-int',has_traffic_filtering=True,id=43cc3477-2288-4c03-8374-5701e3d3baa1,network=Network(67c50821-8012-4a48-8c3a-b0cc3d2ddcb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43cc3477-22') Jun 26 10:39:23.142236 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lazy-loading 'flavor' on Instance uuid f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:23.268686 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] During sync_power_state the instance has a pending task (spawning). Skip. Jun 26 10:39:23.283622 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Took 34.58 seconds to spawn the instance on the hypervisor. Jun 26 10:39:23.283784 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:23.291147 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:39:23.359456 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-433bad42-01df-414a-89b3-a02da3e3a6d6 tempest-TestMultiAttachVolumeSwap-1408323251 tempest-TestMultiAttachVolumeSwap-1408323251-project-member] [instance: 81a0f65d-2017-4275-aabe-88bc8c81225d] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:23.824883 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.917s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:23.824883 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Start building networks asynchronously for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 26 10:39:23.840728 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Took 46.94 seconds to build instance. Jun 26 10:39:23.846341 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 2.833s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:23.856778 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98967) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 26 10:39:23.856778 np0000003731 nova-compute[98967]: INFO nova.compute.claims [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Claim successful on node np0000003731 Jun 26 10:39:23.915315 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:24.148350 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.511s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:24.346421 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-382b5cb4-0a85-41a3-a5b4-46161ffeb965 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 48.461s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:24.359460 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Allocating IP information in the background. {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 26 10:39:24.359460 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] allocate_for_instance() {{(pid=98967) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 26 10:39:24.359460 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:24.360502 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:24.485741 np0000003731 nova-compute[98967]: DEBUG nova.policy [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2a7c139c060e4c998d31cf957835db61', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39600b204ad64a6db28676693c86dd70', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98967) authorize /opt/stack/nova/nova/policy.py:192}} Jun 26 10:39:24.622521 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:39:24.622521 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:39:24.622521 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] No VIF found with MAC fa:16:3e:0e:19:b0, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:39:24.622521 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Using config drive Jun 26 10:39:24.871810 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 26 10:39:25.033133 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-2fcc881b-cddb-45c2-93ba-bb11296a663b req-a17d64c1-7dd6-42b2-a7ba-e9deb5b8a57a service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-changed-49031ae0-122b-4f20-8d73-20048a6ad965 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:25.033133 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-2fcc881b-cddb-45c2-93ba-bb11296a663b req-a17d64c1-7dd6-42b2-a7ba-e9deb5b8a57a service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Refreshing instance network info cache due to event network-changed-49031ae0-122b-4f20-8d73-20048a6ad965. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:39:25.033133 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-2fcc881b-cddb-45c2-93ba-bb11296a663b req-a17d64c1-7dd6-42b2-a7ba-e9deb5b8a57a service nova] Acquiring lock "refresh_cache-ee4d14ad-8bd2-4b8b-9526-51abafe757f2" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:39:25.033133 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-2fcc881b-cddb-45c2-93ba-bb11296a663b req-a17d64c1-7dd6-42b2-a7ba-e9deb5b8a57a service nova] Acquired lock "refresh_cache-ee4d14ad-8bd2-4b8b-9526-51abafe757f2" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:39:25.033133 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-2fcc881b-cddb-45c2-93ba-bb11296a663b req-a17d64c1-7dd6-42b2-a7ba-e9deb5b8a57a service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Refreshing network info cache for port 49031ae0-122b-4f20-8d73-20048a6ad965 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:39:25.135814 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:25.238190 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Refreshing inventories for resource provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:822}} Jun 26 10:39:25.292375 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Successfully created port: 603c0b2c-d13b-48d6-a1a0-77c17c62c23e {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:39:25.314229 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Updating ProviderTree inventory for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d from _refresh_and_get_inventory using data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) _refresh_and_get_inventory /opt/stack/nova/nova/scheduler/client/report.py:786}} Jun 26 10:39:25.314428 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Updating inventory in ProviderTree for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d with inventory: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:176}} Jun 26 10:39:25.324087 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Creating config drive at /opt/stack/data/nova/instances/b53c3532-08c2-4c05-b5e5-c217d3ef4d9a/disk.config Jun 26 10:39:25.328125 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b53c3532-08c2-4c05-b5e5-c217d3ef4d9a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2xeh2a44 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:25.365845 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Start building block device mappings for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 26 10:39:25.388377 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b53c3532-08c2-4c05-b5e5-c217d3ef4d9a/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp2xeh2a44" returned: 0 in 0.059s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:25.394498 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Refreshing aggregate associations for resource provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d, aggregates: None {{(pid=98967) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:831}} Jun 26 10:39:25.460088 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Refreshing trait associations for resource provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d, traits: COMPUTE_ARCH_PPC64LE,COMPUTE_ACCELERATORS,COMPUTE_GRAPHICS_MODEL_CIRRUS,COMPUTE_NET_VIRTIO_PACKED,COMPUTE_SOUND_MODEL_USB,COMPUTE_NODE,COMPUTE_IMAGE_TYPE_AKI,COMPUTE_GRAPHICS_MODEL_NONE,COMPUTE_IMAGE_TYPE_ISO,COMPUTE_VIOMMU_MODEL_SMMUV3,COMPUTE_SOUND_MODEL_ICH6,COMPUTE_SOUND_MODEL_ICH9,COMPUTE_STORAGE_BUS_IDE,COMPUTE_NET_ATTACH_INTERFACE,HW_CPU_X86_SSE41,COMPUTE_IMAGE_TYPE_AMI,HW_CPU_X86_SSSE3,COMPUTE_NET_VIF_MODEL_VIRTIO,COMPUTE_IMAGE_TYPE_ARI,COMPUTE_NET_VIF_MODEL_E1000,COMPUTE_ARCH_AARCH64,COMPUTE_STORAGE_BUS_VIRTIO,HW_CPU_X86_SSE,HW_CPU_X86_SSE2,COMPUTE_SOUND_MODEL_PCSPK,COMPUTE_GRAPHICS_MODEL_VGA,COMPUTE_STORAGE_BUS_SATA,COMPUTE_NET_ATTACH_INTERFACE_WITH_TAG,COMPUTE_VOLUME_ATTACH_WITH_TAG,COMPUTE_ARCH_S390X,COMPUTE_GRAPHICS_MODEL_VMVGA,COMPUTE_SOCKET_PCI_NUMA_AFFINITY,COMPUTE_ARCH_MIPSEL,COMPUTE_STORAGE_BUS_FDC,COMPUTE_NET_VIF_MODEL_VMXNET3,HW_ARCH_X86_64,COMPUTE_NET_VIF_MODEL_SPAPR_VLAN,COMPUTE_RESCUE_BFV,COMPUTE_SECURITY_UEFI_SECURE_BOOT,COMPUTE_IMAGE_TYPE_RAW,COMPUTE_NET_VIF_MODEL_RTL8139,COMPUTE_NET_VIF_MODEL_IGB,COMPUTE_STORAGE_BUS_USB,HW_CPU_X86_MMX,COMPUTE_GRAPHICS_MODEL_VIRTIO,COMPUTE_DEVICE_TAGGING,COMPUTE_GRAPHICS_MODEL_QXL,COMPUTE_ADDRESS_SPACE_PASSTHROUGH,COMPUTE_NET_VIF_MODEL_LAN9118,COMPUTE_VOLUME_MULTI_ATTACH,COMPUTE_TRUSTED_CERTS,COMPUTE_IMAGE_TYPE_QCOW2,COMPUTE_GRAPHICS_MODEL_BOCHS,COMPUTE_NET_VIF_MODEL_E1000E,COMPUTE_STORAGE_VIRTIO_FS,COMPUTE_NET_VIF_MODEL_PCNET,COMPUTE_NET_VIF_MODEL_NE2K_PCI,COMPUTE_VIOMMU_MODEL_AUTO,HW_CPU_X86_SSE42,COMPUTE_VIOMMU_MODEL_INTEL,COMPUTE_VOLUME_EXTEND,COMPUTE_ARCH_RISCV64,COMPUTE_STORAGE_BUS_SCSI,COMPUTE_VIOMMU_MODEL_VIRTIO,COMPUTE_ARCH_X86_64,COMPUTE_SECURITY_STATELESS_FIRMWARE,COMPUTE_ADDRESS_SPACE_EMULATED,COMPUTE_SOUND_MODEL_ES1370,COMPUTE_SOUND_MODEL_AC97,COMPUTE_SOUND_MODEL_SB16 {{(pid=98967) _refresh_associations /opt/stack/nova/nova/scheduler/client/report.py:843}} Jun 26 10:39:25.529017 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-2fcc881b-cddb-45c2-93ba-bb11296a663b req-a17d64c1-7dd6-42b2-a7ba-e9deb5b8a57a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:25.565788 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:25.565977 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:25.566243 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Attaching volume 1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d to /dev/vdb Jun 26 10:39:25.636544 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.79', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003731', 'execute': None}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:39:25.649956 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.scaleio [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98967) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 10:39:25.680761 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): nvme version {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:25.736657 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] 'nvme version' failed. Not Retrying. {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 10:39:25.736948 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.nvmeof [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] nvme not present on system {{(pid=98967) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 10:39:25.754215 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98967) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 10:39:25.754215 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.lightos [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Current host hostNQN and IP(s) are ['10.4.3.79', 'fe80::f816:3eff:fe55:ba34', '192.168.40.6', 'fe80::f816:3eff:fe6b:fe1a', '192.168.50.6', 'fe80::f816:3eff:feca:9cd0', '192.168.10.6', 'fe80::f816:3eff:feb4:4e78', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f8bb:38ff:fe28:ff4a', 'fe80::fc16:3eff:fe37:b3f6', 'fe80::41a:feff:fe02:479d', 'fe80::fc16:3eff:fe5e:459', 'fe80::fc16:3eff:fe90:be9c', 'fe80::84cb:23ff:fe8e:e6e6', 'fe80::fc16:3eff:fe5a:811a', 'fe80::fc16:3eff:fe1b:5509', 'fe80::fc16:3eff:fe48:bca4', 'fe80::fc16:3eff:fef2:781c', 'fe80::b448:c6ff:fe9c:a1e9', 'fe80::fc16:3eff:fe78:446c', 'fe80::fc16:3eff:fe43:d828', 'fe80::fc16:3eff:fe9c:6906', 'fe80::bc5e:80ff:fe69:218d', 'fe80::fc16:3eff:fefd:1020', 'fe80::fc16:3eff:fe17:f5ed', 'fe80::e4d7:e7ff:fe80:d900', 'fe80::fc16:3eff:feec:35bf', 'fe80::fc16:3eff:fe52:9c9b', 'fe80::fc16:3eff:feac:bc0b', 'fe80::fc16:3eff:feb3:64e7', 'fe80::fc16:3eff:fe6a:a465', 'fe80::6cd3:9eff:fe53:c46c', 'fe80::bc4e:7ff:fef8:a00a'] Jun 26 10:39:25.754215 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 10:39:25.754215 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] LIGHTOS: no hostnqn found. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 10:39:25.754215 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] <== get_connector_properties: return (114ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.79', 'host': 'np0000003731', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:2fddcc2116d6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '7f2a0776-2f14-4357-a22e-baa6677eb22e', 'nvme_native_multipath': False} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:39:25.754215 np0000003731 nova-compute[98967]: DEBUG nova.virt.block_device [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Updating existing volume attachment record: d39491bb-ad12-43aa-bdee-b1169d528e7c {{(pid=98967) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 26 10:39:25.911050 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:25.954995 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:25.965541 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:26.062152 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:26.133684 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:26.136972 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:26.322883 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-2fcc881b-cddb-45c2-93ba-bb11296a663b req-a17d64c1-7dd6-42b2-a7ba-e9deb5b8a57a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:26.367832 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Calling os-brick to attach iSCSI Volume {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 26 10:39:26.368364 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:39:26.368794 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:26.369139 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:26.369466 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 10:39:26.381166 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Start spawning the instance on the hypervisor. {{(pid=98967) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 26 10:39:26.382624 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Creating instance directory {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 26 10:39:26.382867 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Creating image(s) Jun 26 10:39:26.383445 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "/opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:26.384506 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "/opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:26.385359 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "/opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.002s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:26.385924 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:39:26.391066 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:39:26.395856 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:26.396430 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:26.411245 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.014s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:26.413619 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:39:26.414338 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:26.419846 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.005s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:26.419846 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.startup = automatic Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.scan = manual Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.40.100 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.startup = automatic Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.scan = manual Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.50.100 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:39:26.440646 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:26.461834 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:26.463955 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:26.491921 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:26.491921 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:26.491921 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:26.491921 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:26.491921 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:26.491921 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:26.491921 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:26.491921 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:26.491921 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:26.491921 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:26.491921 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:26.491921 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:26.491921 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:26.491921 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:26.491921 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:26.491921 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:26.491921 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:26.491921 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:26.491921 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:26.491921 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:26.491921 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:26.491921 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:26.491921 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:26.491921 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:26.491921 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:26.491921 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:26.491921 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.073s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:39:26.491921 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Connected to 192.168.50.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:39:26.493127 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] HCTL ('15', '0', '0', 0) found on session 28 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:39:26.493127 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Scanning host 15 c: 0, t: 0, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:39:26.494749 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:26.494749 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:26.494749 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:26.494749 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:26.494749 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:26.494749 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:26.494749 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:26.494749 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:26.494749 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:26.494749 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:26.494749 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:26.494749 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:26.494749 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:26.494749 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:26.494749 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:26.494749 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:26.494749 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:26.494749 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:26.494749 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:26.494749 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:26.494749 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:26.494749 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:26.494749 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:26.494749 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:26.494749 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:26.494749 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:26.498119 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.085s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:39:26.498119 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Connected to 192.168.40.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:39:26.498119 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] HCTL ('16', '0', '0', 0) found on session 29 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:39:26.498119 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Scanning host 16 c: 0, t: 0, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:39:26.511336 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Searching for a device in session 28 and hctl ('15', '0', '0', 0) yield: sdj {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:39:26.511336 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:39:26.513827 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Searching for a device in session 29 and hctl ('16', '0', '0', 0) yield: sdk {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:39:26.514061 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:39:26.517527 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.122s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:26.518508 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:26.518937 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:26.523046 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:39:26.524691 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:39:26.527347 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:26.544553 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Successfully updated port: 603c0b2c-d13b-48d6-a1a0-77c17c62c23e {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:39:26.606198 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-ec45169d-93db-4e28-b1d7-b1d97171cf9a req-8af27afc-07c0-4a4c-a84e-1abc04a889f4 service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Received event network-changed-603c0b2c-d13b-48d6-a1a0-77c17c62c23e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:26.608695 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-ec45169d-93db-4e28-b1d7-b1d97171cf9a req-8af27afc-07c0-4a4c-a84e-1abc04a889f4 service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Refreshing instance network info cache due to event network-changed-603c0b2c-d13b-48d6-a1a0-77c17c62c23e. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:39:26.608695 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-ec45169d-93db-4e28-b1d7-b1d97171cf9a req-8af27afc-07c0-4a4c-a84e-1abc04a889f4 service nova] Acquiring lock "refresh_cache-edf92675-15b4-424f-85b5-80341e77b578" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:39:26.615098 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-ec45169d-93db-4e28-b1d7-b1d97171cf9a req-8af27afc-07c0-4a4c-a84e-1abc04a889f4 service nova] Acquired lock "refresh_cache-edf92675-15b4-424f-85b5-80341e77b578" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:39:26.615098 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-ec45169d-93db-4e28-b1d7-b1d97171cf9a req-8af27afc-07c0-4a4c-a84e-1abc04a889f4 service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Refreshing network info cache for port 603c0b2c-d13b-48d6-a1a0-77c17c62c23e {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:39:26.643579 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.113s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:26.643579 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578/disk 1073741824 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:26.695893 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:39:26.696318 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:39:26.714984 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:26.757598 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578/disk 1073741824" returned: 0 in 0.117s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:26.758119 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.239s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:26.758540 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:26.833535 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-2fcc881b-cddb-45c2-93ba-bb11296a663b req-a17d64c1-7dd6-42b2-a7ba-e9deb5b8a57a service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Updated VIF entry in instance network info cache for port 49031ae0-122b-4f20-8d73-20048a6ad965. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:39:26.834426 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-2fcc881b-cddb-45c2-93ba-bb11296a663b req-a17d64c1-7dd6-42b2-a7ba-e9deb5b8a57a service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Updating instance_info_cache with network_info: [{"id": "49031ae0-122b-4f20-8d73-20048a6ad965", "address": "fa:16:3e:fd:10:20", "network": {"id": "8142386b-fc69-434d-9373-4536e94d3e62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-385739110-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49031ae0-12", "ovs_interfaceid": "49031ae0-122b-4f20-8d73-20048a6ad965", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "ebb9bc95-98ee-43f1-bd95-8a3da5497c72", "address": "fa:16:3e:17:f5:ed", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb9bc95-98", "ovs_interfaceid": "ebb9bc95-98ee-43f1-bd95-8a3da5497c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "dcce8bc4-9171-4ef4-b762-37d89aea863b", "address": "fa:16:3e:ec:35:bf", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcce8bc4-91", "ovs_interfaceid": "dcce8bc4-9171-4ef4-b762-37d89aea863b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}}, {"id": "9882d815-8273-4eb8-937b-a1c1e4af4018", "address": "fa:16:3e:52:9c:9b", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9882d815-82", "ovs_interfaceid": "9882d815-8273-4eb8-937b-a1c1e4af4018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "8d782392-1caa-4b0a-b7e2-58c03357a004", "address": "fa:16:3e:ac:bc:0b", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d782392-1c", "ovs_interfaceid": "8d782392-1caa-4b0a-b7e2-58c03357a004", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "45a4f3f8-69ee-4cc0-811e-a1178c8b18f2", "address": "fa:16:3e:b3:64:e7", "network": {"id": "567865ec-590f-489f-ba94-79b2150230b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-814227769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a4f3f8-69", "ovs_interfaceid": "45a4f3f8-69ee-4cc0-811e-a1178c8b18f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "c2ff0bc1-8b84-4517-b347-f78bb6a9e14c", "address": "fa:16:3e:6a:a4:65", "network": {"id": "567865ec-590f-489f-ba94-79b2150230b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-814227769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ff0bc1-8b", "ovs_interfaceid": "c2ff0bc1-8b84-4517-b347-f78bb6a9e14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:39:26.854781 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.096s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:26.855213 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Checking if we can resize image /opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578/disk. size=1073741824 {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 26 10:39:26.855469 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:26.945327 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:26.946014 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Cannot resize image /opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578/disk to a smaller size. {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 26 10:39:26.946552 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Created local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 26 10:39:26.946804 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Ensure instance console log exists: /opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578/console.log {{(pid=98967) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 26 10:39:26.947441 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:26.947737 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:26.947957 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:27.058326 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "refresh_cache-edf92675-15b4-424f-85b5-80341e77b578" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:39:27.133139 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-ec45169d-93db-4e28-b1d7-b1d97171cf9a req-8af27afc-07c0-4a4c-a84e-1abc04a889f4 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:27.161571 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-91265bfb-77d9-4bd6-be6c-83899e36f6ac req-c00aa89d-03cb-4f65-951a-e2c809e5d9ac service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Received event network-vif-plugged-43cc3477-2288-4c03-8374-5701e3d3baa1 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:27.161571 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-91265bfb-77d9-4bd6-be6c-83899e36f6ac req-c00aa89d-03cb-4f65-951a-e2c809e5d9ac service nova] Acquiring lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:27.161571 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-91265bfb-77d9-4bd6-be6c-83899e36f6ac req-c00aa89d-03cb-4f65-951a-e2c809e5d9ac service nova] Lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:27.161571 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-91265bfb-77d9-4bd6-be6c-83899e36f6ac req-c00aa89d-03cb-4f65-951a-e2c809e5d9ac service nova] Lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:27.161571 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-91265bfb-77d9-4bd6-be6c-83899e36f6ac req-c00aa89d-03cb-4f65-951a-e2c809e5d9ac service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Processing event network-vif-plugged-43cc3477-2288-4c03-8374-5701e3d3baa1 {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:39:27.201443 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:39:27.277251 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-ec45169d-93db-4e28-b1d7-b1d97171cf9a req-8af27afc-07c0-4a4c-a84e-1abc04a889f4 service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:39:27.342771 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-2fcc881b-cddb-45c2-93ba-bb11296a663b req-a17d64c1-7dd6-42b2-a7ba-e9deb5b8a57a service nova] Releasing lock "refresh_cache-ee4d14ad-8bd2-4b8b-9526-51abafe757f2" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:39:27.421378 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 26 10:39:27.504333 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:27.537278 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-ec45169d-93db-4e28-b1d7-b1d97171cf9a req-8af27afc-07c0-4a4c-a84e-1abc04a889f4 service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:39:27.602360 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:39:27.602524 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] VM Started (Lifecycle Event) Jun 26 10:39:27.603629 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:39:27.614603 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Guest created on hypervisor {{(pid=98967) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 26 10:39:27.642309 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Instance spawned successfully. Jun 26 10:39:27.649427 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 26 10:39:27.718072 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.870s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:27.718072 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Start building networks asynchronously for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 26 10:39:28.040743 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-ec45169d-93db-4e28-b1d7-b1d97171cf9a req-8af27afc-07c0-4a4c-a84e-1abc04a889f4 service nova] Releasing lock "refresh_cache-edf92675-15b4-424f-85b5-80341e77b578" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:39:28.041074 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquired lock "refresh_cache-edf92675-15b4-424f-85b5-80341e77b578" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:39:28.041302 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:39:28.085477 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:28.106666 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:28.108966 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:39:28.149118 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Found default for hw_cdrom_bus of ide {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:28.149971 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Found default for hw_disk_bus of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:28.150460 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Found default for hw_input_bus of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:28.150989 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Found default for hw_pointer_model of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:28.151462 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Found default for hw_video_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:28.151950 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Found default for hw_vif_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:28.222719 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Allocating IP information in the background. {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 26 10:39:28.222876 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] allocate_for_instance() {{(pid=98967) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 26 10:39:28.223279 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:28.223634 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:28.325710 np0000003731 nova-compute[98967]: DEBUG nova.policy [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '11ad63f2d09c4e7dac51c03de3a31f4a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '40a4e84471c94128b1ac4dd00ca7177b', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98967) authorize /opt/stack/nova/nova/policy.py:192}} Jun 26 10:39:28.444375 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Found WWN 3300000008cbe0377 for multipath device dm-8 {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 26 10:39:28.444375 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.074s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:39:28.444375 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] <== connect_volume: return (2074ms) {'type': 'block', 'scsi_wwn': '3300000008cbe0377', 'path': '/dev/dm-8', 'multipath_id': '3300000008cbe0377'} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:39:28.444375 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008cbe0377', 'path': '/dev/dm-8', 'multipath_id': '3300000008cbe0377'} {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 26 10:39:28.453843 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lazy-loading 'flavor' on Instance uuid f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:28.611339 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] During sync_power_state the instance has a pending task (spawning). Skip. Jun 26 10:39:28.611638 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Paused> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:39:28.611757 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] VM Paused (Lifecycle Event) Jun 26 10:39:28.625495 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:39:28.658811 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Took 11.07 seconds to spawn the instance on the hypervisor. Jun 26 10:39:28.659090 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:28.726804 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 26 10:39:28.903470 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:28.957969 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Attempting to attach volume 1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98967) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 26 10:39:28.960387 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] attach device xml: Jun 26 10:39:28.960387 np0000003731 nova-compute[98967]: Jun 26 10:39:28.960387 np0000003731 nova-compute[98967]: Jun 26 10:39:28.960387 np0000003731 nova-compute[98967]: Jun 26 10:39:28.960387 np0000003731 nova-compute[98967]: Jun 26 10:39:28.960387 np0000003731 nova-compute[98967]: 1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d Jun 26 10:39:28.960387 np0000003731 nova-compute[98967]: Jun 26 10:39:28.960387 np0000003731 nova-compute[98967]: Jun 26 10:39:28.960387 np0000003731 nova-compute[98967]: {{(pid=98967) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 26 10:39:29.117047 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:29.127528 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:39:29.134456 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] VM Resumed (Lifecycle Event) Jun 26 10:39:29.154503 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Updating instance_info_cache with network_info: [{"id": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "address": "fa:16:3e:97:32:1f", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap603c0b2c-d1", "ovs_interfaceid": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:39:29.172530 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Took 22.50 seconds to build instance. Jun 26 10:39:29.231817 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Start building block device mappings for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 26 10:39:29.287851 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-c5b63af2-e86e-4f93-a897-db001a7cd545 req-0075527c-64dd-4186-9214-92416ed5a8e9 service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Received event network-vif-plugged-43cc3477-2288-4c03-8374-5701e3d3baa1 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:29.287851 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c5b63af2-e86e-4f93-a897-db001a7cd545 req-0075527c-64dd-4186-9214-92416ed5a8e9 service nova] Acquiring lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:29.287851 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c5b63af2-e86e-4f93-a897-db001a7cd545 req-0075527c-64dd-4186-9214-92416ed5a8e9 service nova] Lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:29.287851 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c5b63af2-e86e-4f93-a897-db001a7cd545 req-0075527c-64dd-4186-9214-92416ed5a8e9 service nova] Lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:29.287851 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-c5b63af2-e86e-4f93-a897-db001a7cd545 req-0075527c-64dd-4186-9214-92416ed5a8e9 service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] No waiting events found dispatching network-vif-plugged-43cc3477-2288-4c03-8374-5701e3d3baa1 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:39:29.287851 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-c5b63af2-e86e-4f93-a897-db001a7cd545 req-0075527c-64dd-4186-9214-92416ed5a8e9 service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Received unexpected event network-vif-plugged-43cc3477-2288-4c03-8374-5701e3d3baa1 for instance with vm_state active and task_state None. Jun 26 10:39:29.558587 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Successfully created port: 288e6be4-7ae8-4847-ad8e-a0b0b95afa6d {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:39:29.630312 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:29.632358 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:39:29.657031 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Releasing lock "refresh_cache-edf92675-15b4-424f-85b5-80341e77b578" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:39:29.657281 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Instance network_info: |[{"id": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "address": "fa:16:3e:97:32:1f", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap603c0b2c-d1", "ovs_interfaceid": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 26 10:39:29.659424 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Start _get_guest_xml network_info=[{"id": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "address": "fa:16:3e:97:32:1f", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap603c0b2c-d1", "ovs_interfaceid": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'image_id': 'a9b18127-6fee-4ed6-b364-a2d634ecb8b7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:39:29.666519 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:39:29.666519 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1844479358', uuid='edf92675-15b4-424f-85b5-80341e77b578'), owner=OwnerMeta(userid='2a7c139c060e4c998d31cf957835db61', username='tempest-AttachVolumeShelveTestJSON-959960600-project-member', projectid='39600b204ad64a6db28676693c86dd70', projectname='tempest-AttachVolumeShelveTestJSON-959960600'), image=ImageMeta(id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "address": "fa:16:3e:97:32:1f", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap603c0b2c-d1", "ovs_interfaceid": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470369.6624885) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:39:29.666519 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:39:29.666519 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:39:29.666783 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:39:29.666812 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:39:29.667805 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:39:29.668102 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:39:29.668247 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:39:29.668343 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:39:29.668454 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:39:29.668560 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:39:29.668656 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:39:29.668784 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:39:29.668903 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:39:29.669218 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:39:29.669340 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:39:29.669450 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:39:29.677389 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-40d53c27-459f-4df9-8f28-886980adafab tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 24.009s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:29.681121 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1844479358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-attachvolumeshelvetestjson-server-1844479358',id=21,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGT3OPooMXq6iVcWa/Fwd14Ks/bkgC0xhuWPvKDIBt4A/bbkEKcU9puz90qHDGD6yfeUp0YpMtCA+rPiBhD1nHMQaj8vN/wAcXoQ6VCsvKjnCh464ti06dZKcXcP2/fnUg==',key_name='tempest-keypair-52848182',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39600b204ad64a6db28676693c86dd70',ramdisk_id='',reservation_id='r-25v3smsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-959960600',owner_user_name='tempest-AttachVolumeShelveTestJSON-959960600-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:39:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a7c139c060e4c998d31cf957835db61',uuid=edf92675-15b4-424f-85b5-80341e77b578,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "address": "fa:16:3e:97:32:1f", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap603c0b2c-d1", "ovs_interfaceid": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:39:29.688656 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Converting VIF {"id": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "address": "fa:16:3e:97:32:1f", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap603c0b2c-d1", "ovs_interfaceid": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:39:29.688656 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:32:1f,bridge_name='br-int',has_traffic_filtering=True,id=603c0b2c-d13b-48d6-a1a0-77c17c62c23e,network=Network(79bcd519-98c3-4905-a83f-c080654f2cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603c0b2c-d1') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:39:29.688656 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lazy-loading 'pci_devices' on Instance uuid edf92675-15b4-424f-85b5-80341e77b578 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:29.736162 np0000003731 nova-compute[98967]: INFO nova.virt.block_device [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Booting with volume 0838d3e5-41a4-4e26-b090-b276de7370ee at /dev/vda Jun 26 10:39:29.850165 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.79', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003731', 'execute': None}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:39:29.865040 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.scaleio [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98967) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 10:39:29.897147 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Running cmd (subprocess): nvme version {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:29.938898 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] 'nvme version' failed. Not Retrying. {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 10:39:29.939943 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.nvmeof [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] nvme not present on system {{(pid=98967) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 10:39:29.957920 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98967) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 10:39:29.961160 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.lightos [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Current host hostNQN and IP(s) are ['10.4.3.79', 'fe80::f816:3eff:fe55:ba34', '192.168.40.6', 'fe80::f816:3eff:fe6b:fe1a', '192.168.50.6', 'fe80::f816:3eff:feca:9cd0', '192.168.10.6', 'fe80::f816:3eff:feb4:4e78', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f8bb:38ff:fe28:ff4a', 'fe80::fc16:3eff:fe37:b3f6', 'fe80::41a:feff:fe02:479d', 'fe80::fc16:3eff:fe5e:459', 'fe80::fc16:3eff:fe90:be9c', 'fe80::84cb:23ff:fe8e:e6e6', 'fe80::fc16:3eff:fe5a:811a', 'fe80::fc16:3eff:fe1b:5509', 'fe80::fc16:3eff:fe48:bca4', 'fe80::fc16:3eff:fef2:781c', 'fe80::b448:c6ff:fe9c:a1e9', 'fe80::fc16:3eff:fe78:446c', 'fe80::fc16:3eff:fe43:d828', 'fe80::fc16:3eff:fe9c:6906', 'fe80::bc5e:80ff:fe69:218d', 'fe80::fc16:3eff:fefd:1020', 'fe80::fc16:3eff:fe17:f5ed', 'fe80::e4d7:e7ff:fe80:d900', 'fe80::fc16:3eff:feec:35bf', 'fe80::fc16:3eff:fe52:9c9b', 'fe80::fc16:3eff:feac:bc0b', 'fe80::fc16:3eff:feb3:64e7', 'fe80::fc16:3eff:fe6a:a465', 'fe80::6cd3:9eff:fe53:c46c', 'fe80::bc4e:7ff:fef8:a00a', 'fe80::fc16:3eff:fe0e:19b0'] Jun 26 10:39:29.961160 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 10:39:29.961160 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] LIGHTOS: no hostnqn found. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 10:39:29.961466 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] <== get_connector_properties: return (110ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.79', 'host': 'np0000003731', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:2fddcc2116d6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '7f2a0776-2f14-4357-a22e-baa6677eb22e', 'nvme_native_multipath': False} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:39:29.961703 np0000003731 nova-compute[98967]: DEBUG nova.virt.block_device [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Updating existing volume attachment record: 0a1ec62f-d8a6-4f8a-8624-8a96d816714d {{(pid=98967) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] End _get_guest_xml xml= Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: edf92675-15b4-424f-85b5-80341e77b578 Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: instance-00000015 Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: 196608 Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: tempest-AttachVolumeShelveTestJSON-server-1844479358 Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: 2026-06-26 10:39:29 Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: 192 Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: 0 Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: 0 Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: True Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: bare Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: 0 Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: virtio Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: tempest-AttachVolumeShelveTestJSON-959960600-project-member Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: tempest-AttachVolumeShelveTestJSON-959960600 Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: edf92675-15b4-424f-85b5-80341e77b578 Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: edf92675-15b4-424f-85b5-80341e77b578 Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: hvm Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: 128 Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: Jun 26 10:39:30.187344 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:39:30.190448 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Preparing to wait for external event network-vif-plugged-603c0b2c-d13b-48d6-a1a0-77c17c62c23e {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:39:30.190448 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "edf92675-15b4-424f-85b5-80341e77b578-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:30.190448 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "edf92675-15b4-424f-85b5-80341e77b578-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:30.190448 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "edf92675-15b4-424f-85b5-80341e77b578-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:30.190448 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1844479358',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-attachvolumeshelvetestjson-server-1844479358',id=21,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGT3OPooMXq6iVcWa/Fwd14Ks/bkgC0xhuWPvKDIBt4A/bbkEKcU9puz90qHDGD6yfeUp0YpMtCA+rPiBhD1nHMQaj8vN/wAcXoQ6VCsvKjnCh464ti06dZKcXcP2/fnUg==',key_name='tempest-keypair-52848182',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='39600b204ad64a6db28676693c86dd70',ramdisk_id='',reservation_id='r-25v3smsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-AttachVolumeShelveTestJSON-959960600',owner_user_name='tempest-AttachVolumeShelveTestJSON-959960600-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:39:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a7c139c060e4c998d31cf957835db61',uuid=edf92675-15b4-424f-85b5-80341e77b578,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "address": "fa:16:3e:97:32:1f", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap603c0b2c-d1", "ovs_interfaceid": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:39:30.190448 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Converting VIF {"id": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "address": "fa:16:3e:97:32:1f", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap603c0b2c-d1", "ovs_interfaceid": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:39:30.190947 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:32:1f,bridge_name='br-int',has_traffic_filtering=True,id=603c0b2c-d13b-48d6-a1a0-77c17c62c23e,network=Network(79bcd519-98c3-4905-a83f-c080654f2cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603c0b2c-d1') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:39:30.191349 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:32:1f,bridge_name='br-int',has_traffic_filtering=True,id=603c0b2c-d13b-48d6-a1a0-77c17c62c23e,network=Network(79bcd519-98c3-4905-a83f-c080654f2cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603c0b2c-d1') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:39:30.193337 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:30.193689 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:30.193968 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:39:30.195568 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:30.195755 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5d5070d2-ddb1-5953-abd4-f820a980c760', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:30.198185 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:30.198932 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:39:30.204568 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:30.204839 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap603c0b2c-d1, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:30.205169 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap603c0b2c-d1, col_values=(('qos', UUID('ca12e08b-4669-4454-a1be-19110169e2a0')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:30.205361 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap603c0b2c-d1, col_values=(('external_ids', {'iface-id': '603c0b2c-d13b-48d6-a1a0-77c17c62c23e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:32:1f', 'vm-uuid': 'edf92675-15b4-424f-85b5-80341e77b578'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:30.206672 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:30.208930 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:39:30.216837 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:30.217461 np0000003731 nova-compute[98967]: INFO os_vif [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:32:1f,bridge_name='br-int',has_traffic_filtering=True,id=603c0b2c-d13b-48d6-a1a0-77c17c62c23e,network=Network(79bcd519-98c3-4905-a83f-c080654f2cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603c0b2c-d1') Jun 26 10:39:30.429729 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Successfully updated port: 288e6be4-7ae8-4847-ad8e-a0b0b95afa6d {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:39:30.498996 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-52ee7515-1108-412d-9735-1025ac585e39 req-114f7bf9-cb9c-4024-94f9-3f1e8dd33f82 service nova] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Received event network-changed-288e6be4-7ae8-4847-ad8e-a0b0b95afa6d {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:30.502365 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-52ee7515-1108-412d-9735-1025ac585e39 req-114f7bf9-cb9c-4024-94f9-3f1e8dd33f82 service nova] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Refreshing instance network info cache due to event network-changed-288e6be4-7ae8-4847-ad8e-a0b0b95afa6d. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:39:30.502710 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-52ee7515-1108-412d-9735-1025ac585e39 req-114f7bf9-cb9c-4024-94f9-3f1e8dd33f82 service nova] Acquiring lock "refresh_cache-3dd6ac52-de12-47da-bc90-77d0fff44acf" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:39:30.502765 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-52ee7515-1108-412d-9735-1025ac585e39 req-114f7bf9-cb9c-4024-94f9-3f1e8dd33f82 service nova] Acquired lock "refresh_cache-3dd6ac52-de12-47da-bc90-77d0fff44acf" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:39:30.502918 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-52ee7515-1108-412d-9735-1025ac585e39 req-114f7bf9-cb9c-4024-94f9-3f1e8dd33f82 service nova] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Refreshing network info cache for port 288e6be4-7ae8-4847-ad8e-a0b0b95afa6d {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:39:30.707436 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:39:30.707870 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:39:30.707870 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:39:30.707981 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No VIF found with MAC fa:16:3e:43:d8:28, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:39:30.935239 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Acquiring lock "refresh_cache-3dd6ac52-de12-47da-bc90-77d0fff44acf" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:39:31.005944 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-52ee7515-1108-412d-9735-1025ac585e39 req-114f7bf9-cb9c-4024-94f9-3f1e8dd33f82 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:31.102042 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-52ee7515-1108-412d-9735-1025ac585e39 req-114f7bf9-cb9c-4024-94f9-3f1e8dd33f82 service nova] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:39:31.330861 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-52ee7515-1108-412d-9735-1025ac585e39 req-114f7bf9-cb9c-4024-94f9-3f1e8dd33f82 service nova] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:39:31.740668 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:39:31.741239 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:39:31.741239 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] No VIF found with MAC fa:16:3e:97:32:1f, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:39:31.741684 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Using config drive Jun 26 10:39:31.744637 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Rescuing Jun 26 10:39:31.745923 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "refresh_cache-b53c3532-08c2-4c05-b5e5-c217d3ef4d9a" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:39:31.745923 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquired lock "refresh_cache-b53c3532-08c2-4c05-b5e5-c217d3ef4d9a" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:39:31.745923 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:39:31.833093 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-52ee7515-1108-412d-9735-1025ac585e39 req-114f7bf9-cb9c-4024-94f9-3f1e8dd33f82 service nova] Releasing lock "refresh_cache-3dd6ac52-de12-47da-bc90-77d0fff44acf" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:39:31.833577 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Acquired lock "refresh_cache-3dd6ac52-de12-47da-bc90-77d0fff44acf" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:39:31.833778 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:39:32.123192 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Start spawning the instance on the hypervisor. {{(pid=98967) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 26 10:39:32.124583 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Creating instance directory {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 26 10:39:32.125075 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Creating image(s) Jun 26 10:39:32.125476 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Did not create local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 26 10:39:32.125649 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Ensure instance console log exists: /opt/stack/data/nova/instances/3dd6ac52-de12-47da-bc90-77d0fff44acf/console.log {{(pid=98967) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 26 10:39:32.125979 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:32.126263 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:32.126464 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:32.248524 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:32.254926 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:32.278587 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a8c1bc3b-41bc-431d-a9a2-b5a88ed3f5dc tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 6.712s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:32.426800 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Creating config drive at /opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578/disk.config Jun 26 10:39:32.431038 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqtxh2p3u {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:32.472855 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:39:32.493864 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpqtxh2p3u" returned: 0 in 0.063s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:32.508874 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:32.729984 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:32.734457 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:32.912298 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Updating instance_info_cache with network_info: [{"id": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "address": "fa:16:3e:41:2f:75", "network": {"id": "66d12b1b-32f2-4152-b44c-13e5284b49f9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-186021134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a4e84471c94128b1ac4dd00ca7177b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap288e6be4-7a", "ovs_interfaceid": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:39:32.941990 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Updating instance_info_cache with network_info: [{"id": "43cc3477-2288-4c03-8374-5701e3d3baa1", "address": "fa:16:3e:0e:19:b0", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43cc3477-22", "ovs_interfaceid": "43cc3477-2288-4c03-8374-5701e3d3baa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:39:33.012716 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:33.060728 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:33.175381 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:33.265447 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Acquiring lock "619d915a-12c9-424f-8c12-b2a3f94a4109" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:33.265609 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lock "619d915a-12c9-424f-8c12-b2a3f94a4109" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:33.321290 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-6405d31b-8b63-427b-9154-5533cbece391 req-79e0fc77-8259-4759-aa6b-e42854d5cff2 service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Received event network-vif-plugged-603c0b2c-d13b-48d6-a1a0-77c17c62c23e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:33.321527 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-6405d31b-8b63-427b-9154-5533cbece391 req-79e0fc77-8259-4759-aa6b-e42854d5cff2 service nova] Acquiring lock "edf92675-15b4-424f-85b5-80341e77b578-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:33.321729 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-6405d31b-8b63-427b-9154-5533cbece391 req-79e0fc77-8259-4759-aa6b-e42854d5cff2 service nova] Lock "edf92675-15b4-424f-85b5-80341e77b578-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:33.321972 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-6405d31b-8b63-427b-9154-5533cbece391 req-79e0fc77-8259-4759-aa6b-e42854d5cff2 service nova] Lock "edf92675-15b4-424f-85b5-80341e77b578-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:33.322083 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-6405d31b-8b63-427b-9154-5533cbece391 req-79e0fc77-8259-4759-aa6b-e42854d5cff2 service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Processing event network-vif-plugged-603c0b2c-d13b-48d6-a1a0-77c17c62c23e {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:39:33.415605 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Releasing lock "refresh_cache-3dd6ac52-de12-47da-bc90-77d0fff44acf" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:39:33.415605 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Instance network_info: |[{"id": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "address": "fa:16:3e:41:2f:75", "network": {"id": "66d12b1b-32f2-4152-b44c-13e5284b49f9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-186021134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a4e84471c94128b1ac4dd00ca7177b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap288e6be4-7a", "ovs_interfaceid": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 26 10:39:33.416497 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Start _get_guest_xml network_info=[{"id": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "address": "fa:16:3e:41:2f:75", "network": {"id": "66d12b1b-32f2-4152-b44c-13e5284b49f9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-186021134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a4e84471c94128b1ac4dd00ca7177b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap288e6be4-7a", "ovs_interfaceid": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0838d3e5-41a4-4e26-b090-b276de7370ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '3dd6ac52-de12-47da-bc90-77d0fff44acf', 'attached_at': '', 'detached_at': '', 'volume_id': '0838d3e5-41a4-4e26-b090-b276de7370ee', 'serial': '0838d3e5-41a4-4e26-b090-b276de7370ee'}, 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '0a1ec62f-d8a6-4f8a-8624-8a96d816714d', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:39:33.422921 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:39:33.424209 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-739986196', uuid='3dd6ac52-de12-47da-bc90-77d0fff44acf'), owner=OwnerMeta(userid='11ad63f2d09c4e7dac51c03de3a31f4a', username='tempest-ServerActionsV293TestJSON-1674673586-project-member', projectid='40a4e84471c94128b1ac4dd00ca7177b', projectname='tempest-ServerActionsV293TestJSON-1674673586'), image=ImageMeta(id='', name=None, container_format=None, disk_format=None, min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "address": "fa:16:3e:41:2f:75", "network": {"id": "66d12b1b-32f2-4152-b44c-13e5284b49f9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-186021134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a4e84471c94128b1ac4dd00ca7177b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap288e6be4-7a", "ovs_interfaceid": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470373.4237957) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:39:33.426075 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:39:33.426519 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:39:33.429907 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:39:33.429907 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:39:33.431149 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:39:33.431662 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum=,container_format=,created_at=,direct_url=,disk_format=,id=,min_disk=0,min_ram=0,name=,owner=,properties=ImageMetaProps,protected=,size=1073741824,status='active',tags=,updated_at=,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:39:33.431884 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:39:33.431984 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:39:33.432221 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:39:33.432305 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:39:33.432410 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:39:33.432634 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:39:33.432727 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:39:33.432880 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:39:33.432997 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:39:33.433129 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:39:33.444951 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Releasing lock "refresh_cache-b53c3532-08c2-4c05-b5e5-c217d3ef4d9a" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:39:33.453522 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Calling os-brick to attach iSCSI Volume {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 26 10:39:33.456251 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:33.463774 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0838d3e5-41a4-4e26-b090-b276de7370ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:39:33.463774 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:33.463774 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:33.463774 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0838d3e5-41a4-4e26-b090-b276de7370ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 10:39:33.478265 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:33.479822 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:33.480911 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:33.481144 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:39:33.481733 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:33.482738 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:39:33.488209 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:33.502064 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:39:33.502064 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:33.514569 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:39:33.514569 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:33.518183 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee] added Jun 26 10:39:33.518183 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:39:33.518183 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:39:33.518183 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:39:33.518183 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:39:33.518183 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:39:33.518183 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:33.518183 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:39:33.518925 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0372(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:39:33.518925 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:39:33.529603 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee] added Jun 26 10:39:33.529603 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:39:33.529603 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:39:33.529603 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:39:33.529603 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:39:33.529603 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:39:33.529603 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:33.529886 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:39:33.529995 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0473(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:39:33.530238 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:39:33.774731 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Starting instance... {{(pid=98967) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 26 10:39:34.112723 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:39:34.113283 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: edf92675-15b4-424f-85b5-80341e77b578] VM Started (Lifecycle Event) Jun 26 10:39:34.114112 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:39:34.116849 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Guest created on hypervisor {{(pid=98967) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 26 10:39:34.122124 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: edf92675-15b4-424f-85b5-80341e77b578] Instance spawned successfully. Jun 26 10:39:34.122600 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 26 10:39:34.339302 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:34.339302 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:34.347148 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98967) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 26 10:39:34.347148 np0000003731 nova-compute[98967]: INFO nova.compute.claims [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Claim successful on node np0000003731 Jun 26 10:39:34.519245 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:39:34.530999 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.40.100 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:39:34.537206 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.50.100 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:39:34.546168 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:34.556775 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:34.566653 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:34.572627 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:34.572627 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:34.572627 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:34.572627 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:34.572627 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:34.572627 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:34.572627 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:34.572627 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:34.572627 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:34.572627 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:34.572627 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:34.572627 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:34.572627 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:34.576068 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:34.576068 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:34.576068 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:34.576068 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:34.576068 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:34.576068 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:34.576068 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:34.576068 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:34.576068 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:34.576068 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:34.576068 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:34.576068 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:34.576068 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:34.594410 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:34.594410 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:34.594410 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:34.594410 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:34.594410 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:34.594410 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:34.594410 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:34.594410 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:34.594410 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:34.594410 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:34.594410 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:34.594410 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:34.594410 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:34.594788 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:34.594788 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:34.594788 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:34.594788 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:34.594788 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:34.594788 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:34.594788 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:34.594788 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:34.594788 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:34.594788 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:34.594788 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:34.594788 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:34.594788 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:34.615387 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: edf92675-15b4-424f-85b5-80341e77b578] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:34.616854 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: edf92675-15b4-424f-85b5-80341e77b578] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:39:34.633032 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Found default for hw_cdrom_bus of ide {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:34.633032 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Found default for hw_disk_bus of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:34.633032 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Found default for hw_input_bus of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:34.633032 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Found default for hw_pointer_model of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:34.633032 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Found default for hw_video_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:34.633032 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Found default for hw_vif_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:34.639726 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee, portal: 192.168.40.100,3260] Jun 26 10:39:34.639726 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee, portal: 192.168.40.100,3260] successful. Jun 26 10:39:34.639726 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:34.652491 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:34.657974 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee, portal: 192.168.50.100,3260] Jun 26 10:39:34.657974 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee, portal: 192.168.50.100,3260] successful. Jun 26 10:39:34.657974 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:34.673074 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:34.673513 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:34.673513 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:34.673513 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:34.673513 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:34.673513 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:34.673513 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:34.673513 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:34.673513 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:34.673513 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:34.673513 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:34.673513 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:34.673513 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:34.673513 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:34.673513 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:34.673513 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:34.673882 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:34.673882 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:34.673882 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:34.673882 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:34.673882 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:34.673882 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:34.673882 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:34.673882 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:34.673882 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:34.673882 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:34.673882 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:34.673882 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:34.673882 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:34.673882 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:34.673882 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:34.673882 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.193s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:39:34.674354 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Connected to 192.168.40.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:39:34.675172 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] HCTL ('19', '-', '-', 0) found on session 32 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:39:34.675298 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Scanning host 19 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:39:34.696276 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Searching for a device in session 32 and hctl ['19', '*', '*', 0] yield: sdn {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:39:34.696276 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Connected to sdn using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0838d3e5-41a4-4e26-b090-b276de7370ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:39:34.698820 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:34.698820 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:34.698820 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:34.698820 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:34.698820 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:34.698820 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:34.698820 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:34.698820 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:34.698820 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:34.698820 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:34.698820 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:34.698820 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:34.698820 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:34.698820 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:34.698820 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:34.699351 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:34.699351 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:34.699351 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:34.699351 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:34.699351 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:34.699351 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:34.699351 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:34.699351 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:34.699351 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:34.699351 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:34.699351 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:34.699351 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:34.699351 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:34.699351 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:34.699351 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:34.705324 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.218s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:39:34.705324 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Connected to 192.168.50.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:39:34.705324 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] HCTL ('20', '-', '-', 0) found on session 33 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:39:34.705324 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Scanning host 20 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:39:34.717362 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Searching for a device in session 33 and hctl ['20', '*', '*', 0] yield: None {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:39:35.108351 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:35.116669 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:35.122424 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: edf92675-15b4-424f-85b5-80341e77b578] During sync_power_state the instance has a pending task (spawning). Skip. Jun 26 10:39:35.122424 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Paused> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:39:35.122424 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: edf92675-15b4-424f-85b5-80341e77b578] VM Paused (Lifecycle Event) Jun 26 10:39:35.138469 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Took 8.76 seconds to spawn the instance on the hypervisor. Jun 26 10:39:35.138469 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:35.143969 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:35.206508 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:35.309782 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:35.319954 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:35.391973 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7696c10c-7ffa-437e-9260-e1b0897b045c req-d96cdb3f-822b-4d1a-87b5-7c75ea620620 service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Received event network-vif-unplugged-43cc3477-2288-4c03-8374-5701e3d3baa1 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:35.391973 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7696c10c-7ffa-437e-9260-e1b0897b045c req-d96cdb3f-822b-4d1a-87b5-7c75ea620620 service nova] Acquiring lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:35.391973 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7696c10c-7ffa-437e-9260-e1b0897b045c req-d96cdb3f-822b-4d1a-87b5-7c75ea620620 service nova] Lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:35.391973 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7696c10c-7ffa-437e-9260-e1b0897b045c req-d96cdb3f-822b-4d1a-87b5-7c75ea620620 service nova] Lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:35.391973 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7696c10c-7ffa-437e-9260-e1b0897b045c req-d96cdb3f-822b-4d1a-87b5-7c75ea620620 service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] No waiting events found dispatching network-vif-unplugged-43cc3477-2288-4c03-8374-5701e3d3baa1 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:39:35.391973 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-7696c10c-7ffa-437e-9260-e1b0897b045c req-d96cdb3f-822b-4d1a-87b5-7c75ea620620 service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Received unexpected event network-vif-unplugged-43cc3477-2288-4c03-8374-5701e3d3baa1 for instance with vm_state active and task_state rescuing. Jun 26 10:39:35.409360 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-e2a0fd96-a9ad-44e5-bf07-2b1f58d4e5a8 req-0863e605-c175-4aba-bf18-cfbb80be264b service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Received event network-vif-plugged-603c0b2c-d13b-48d6-a1a0-77c17c62c23e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:35.409360 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-e2a0fd96-a9ad-44e5-bf07-2b1f58d4e5a8 req-0863e605-c175-4aba-bf18-cfbb80be264b service nova] Acquiring lock "edf92675-15b4-424f-85b5-80341e77b578-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:35.409360 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-e2a0fd96-a9ad-44e5-bf07-2b1f58d4e5a8 req-0863e605-c175-4aba-bf18-cfbb80be264b service nova] Lock "edf92675-15b4-424f-85b5-80341e77b578-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:35.409360 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-e2a0fd96-a9ad-44e5-bf07-2b1f58d4e5a8 req-0863e605-c175-4aba-bf18-cfbb80be264b service nova] Lock "edf92675-15b4-424f-85b5-80341e77b578-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:35.409360 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-e2a0fd96-a9ad-44e5-bf07-2b1f58d4e5a8 req-0863e605-c175-4aba-bf18-cfbb80be264b service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] No waiting events found dispatching network-vif-plugged-603c0b2c-d13b-48d6-a1a0-77c17c62c23e {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:39:35.409360 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-e2a0fd96-a9ad-44e5-bf07-2b1f58d4e5a8 req-0863e605-c175-4aba-bf18-cfbb80be264b service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Received unexpected event network-vif-plugged-603c0b2c-d13b-48d6-a1a0-77c17c62c23e for instance with vm_state active and task_state None. Jun 26 10:39:35.420459 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:35.432731 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:35.443250 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Instance destroyed successfully. Jun 26 10:39:35.443776 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lazy-loading 'numa_topology' on Instance uuid b53c3532-08c2-4c05-b5e5-c217d3ef4d9a {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:35.480362 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Stashing vm_state: active {{(pid=98967) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}} Jun 26 10:39:35.628825 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: edf92675-15b4-424f-85b5-80341e77b578] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:35.631644 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:39:35.631644 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: edf92675-15b4-424f-85b5-80341e77b578] VM Resumed (Lifecycle Event) Jun 26 10:39:35.644396 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "c8aff61a-5f59-4f8c-8288-abd5a7853474" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:35.644895 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:35.655058 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Took 14.81 seconds to build instance. Jun 26 10:39:35.720400 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Searching for a device in session 33 and hctl ['20', '*', '*', 0] yield: sdo {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:39:35.720616 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Connected to sdo using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0838d3e5-41a4-4e26-b090-b276de7370ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:39:35.952146 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Attempting a stable device rescue Jun 26 10:39:36.053953 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:36.095139 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} {{(pid=98967) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4640}} Jun 26 10:39:36.099582 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Instance directory exists: not creating {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}} Jun 26 10:39:36.099767 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Creating image(s) Jun 26 10:39:36.100410 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "/opt/stack/data/nova/instances/b53c3532-08c2-4c05-b5e5-c217d3ef4d9a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:36.100604 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "/opt/stack/data/nova/instances/b53c3532-08c2-4c05-b5e5-c217d3ef4d9a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:36.101358 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "/opt/stack/data/nova/instances/b53c3532-08c2-4c05-b5e5-c217d3ef4d9a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:36.101623 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lazy-loading 'trusted_certs' on Instance uuid b53c3532-08c2-4c05-b5e5-c217d3ef4d9a {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:36.137363 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: edf92675-15b4-424f-85b5-80341e77b578] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:36.139461 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: edf92675-15b4-424f-85b5-80341e77b578] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:39:36.149907 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'flavor' on Instance uuid c8aff61a-5f59-4f8c-8288-abd5a7853474 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:36.159361 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-d1243c55-14d9-48b0-8310-4cc41ff56d76 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "edf92675-15b4-424f-85b5-80341e77b578" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 16.321s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:36.269908 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:39:36.270196 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:39:36.508694 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Found WWN 3300000003cd6755d for multipath device dm-10 {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 26 10:39:36.509081 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.048s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:39:36.509410 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] <== connect_volume: return (3048ms) {'type': 'block', 'scsi_wwn': '3300000003cd6755d', 'path': '/dev/dm-10', 'multipath_id': '3300000003cd6755d'} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:39:36.509619 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003cd6755d', 'path': '/dev/dm-10', 'multipath_id': '3300000003cd6755d'} {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 26 10:39:36.603676 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:39:36.604024 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "a96a5f9c05fe6213d0b75523854344c6272ea3c3" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:36.604417 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "a96a5f9c05fe6213d0b75523854344c6272ea3c3" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:36.642365 np0000003731 nova-compute[98967]: DEBUG nova.utils [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Queued Task(fn=>, remaining_delay=14.999635563999846 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:39:36.642910 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.999061501999904 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:39:36.643044 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.998920901999782 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:39:36.775036 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:39:37.017319 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-739986196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-serveractionsv293testjson-server-739986196',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpC408hAS7ZHCLcxOORErGa34r6kFwvPfr3Lp/mseMBy2poBV1dMkTaNTtK74/pNLf0Wh6LpCI1nkrL/Xs5OehD5/80bs1kvQaAe6W4GP47k+Sfo1MyP9GisRKDNYuUyg==',key_name='tempest-keypair-400928869',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40a4e84471c94128b1ac4dd00ca7177b',ramdisk_id='',reservation_id='r-c2y3fxk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1674673586',owner_user_name='tempest-ServerActionsV293TestJSON-1674673586-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:39:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11ad63f2d09c4e7dac51c03de3a31f4a',uuid=3dd6ac52-de12-47da-bc90-77d0fff44acf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "address": "fa:16:3e:41:2f:75", "network": {"id": "66d12b1b-32f2-4152-b44c-13e5284b49f9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-186021134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a4e84471c94128b1ac4dd00ca7177b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap288e6be4-7a", "ovs_interfaceid": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:39:37.017582 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Converting VIF {"id": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "address": "fa:16:3e:41:2f:75", "network": {"id": "66d12b1b-32f2-4152-b44c-13e5284b49f9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-186021134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a4e84471c94128b1ac4dd00ca7177b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap288e6be4-7a", "ovs_interfaceid": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:39:37.018150 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:2f:75,bridge_name='br-int',has_traffic_filtering=True,id=288e6be4-7ae8-4847-ad8e-a0b0b95afa6d,network=Network(66d12b1b-32f2-4152-b44c-13e5284b49f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap288e6be4-7a') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:39:37.018793 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lazy-loading 'pci_devices' on Instance uuid 3dd6ac52-de12-47da-bc90-77d0fff44acf {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:37.155719 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.510s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:37.282941 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 2.944s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:37.283597 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 1.230s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:37.286211 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Start building networks asynchronously for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 26 10:39:37.373062 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:39:37.376399 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:39:37.376399 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a96a5f9c05fe6213d0b75523854344c6272ea3c3.part --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:37.475837 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-1d7ceb2d-6db3-4055-b984-d67238efe192 req-d62df4bf-ee74-49be-9883-cfdb414868e5 service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Received event network-vif-unplugged-43cc3477-2288-4c03-8374-5701e3d3baa1 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:37.475837 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-1d7ceb2d-6db3-4055-b984-d67238efe192 req-d62df4bf-ee74-49be-9883-cfdb414868e5 service nova] Acquiring lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:37.475837 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-1d7ceb2d-6db3-4055-b984-d67238efe192 req-d62df4bf-ee74-49be-9883-cfdb414868e5 service nova] Lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:37.475837 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-1d7ceb2d-6db3-4055-b984-d67238efe192 req-d62df4bf-ee74-49be-9883-cfdb414868e5 service nova] Lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:37.475837 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-1d7ceb2d-6db3-4055-b984-d67238efe192 req-d62df4bf-ee74-49be-9883-cfdb414868e5 service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] No waiting events found dispatching network-vif-unplugged-43cc3477-2288-4c03-8374-5701e3d3baa1 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:39:37.475837 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-1d7ceb2d-6db3-4055-b984-d67238efe192 req-d62df4bf-ee74-49be-9883-cfdb414868e5 service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Received unexpected event network-vif-unplugged-43cc3477-2288-4c03-8374-5701e3d3baa1 for instance with vm_state active and task_state rescuing. Jun 26 10:39:37.476150 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a96a5f9c05fe6213d0b75523854344c6272ea3c3.part --force-share --output=json" returned: 0 in 0.100s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:37.476879 np0000003731 nova-compute[98967]: DEBUG nova.virt.images [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] 986bcae6-4242-40d2-a0e4-752b5cbc4a47 was qcow2, converting to raw {{(pid=98967) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 26 10:39:37.479597 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-0969fde2-dbd3-4d91-bd24-30aa6a5076cd req-8d3a4f63-4f1c-4412-bde3-2244ebd01082 service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Received event network-changed-603c0b2c-d13b-48d6-a1a0-77c17c62c23e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:37.481226 np0000003731 nova-compute[98967]: DEBUG nova.privsep.utils [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98967) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 26 10:39:37.481481 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-0969fde2-dbd3-4d91-bd24-30aa6a5076cd req-8d3a4f63-4f1c-4412-bde3-2244ebd01082 service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Refreshing instance network info cache due to event network-changed-603c0b2c-d13b-48d6-a1a0-77c17c62c23e. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:39:37.481685 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-0969fde2-dbd3-4d91-bd24-30aa6a5076cd req-8d3a4f63-4f1c-4412-bde3-2244ebd01082 service nova] Acquiring lock "refresh_cache-edf92675-15b4-424f-85b5-80341e77b578" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:39:37.481787 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-0969fde2-dbd3-4d91-bd24-30aa6a5076cd req-8d3a4f63-4f1c-4412-bde3-2244ebd01082 service nova] Acquired lock "refresh_cache-edf92675-15b4-424f-85b5-80341e77b578" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:39:37.481980 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-0969fde2-dbd3-4d91-bd24-30aa6a5076cd req-8d3a4f63-4f1c-4412-bde3-2244ebd01082 service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Refreshing network info cache for port 603c0b2c-d13b-48d6-a1a0-77c17c62c23e {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:39:37.482696 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a96a5f9c05fe6213d0b75523854344c6272ea3c3.part /opt/stack/data/nova/instances/_base/a96a5f9c05fe6213d0b75523854344c6272ea3c3.converted {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:37.513049 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] End _get_guest_xml xml= Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: 3dd6ac52-de12-47da-bc90-77d0fff44acf Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: instance-00000016 Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: 196608 Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: tempest-ServerActionsV293TestJSON-server-739986196 Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: 2026-06-26 10:39:33 Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: 192 Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: 0 Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: 0 Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: True Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: 0 Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: virtio Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: tempest-ServerActionsV293TestJSON-1674673586-project-member Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: tempest-ServerActionsV293TestJSON-1674673586 Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: 3dd6ac52-de12-47da-bc90-77d0fff44acf Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: 3dd6ac52-de12-47da-bc90-77d0fff44acf Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: hvm Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: 128 Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: 0838d3e5-41a4-4e26-b090-b276de7370ee Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: Jun 26 10:39:37.526525 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:39:37.529665 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Preparing to wait for external event network-vif-plugged-288e6be4-7ae8-4847-ad8e-a0b0b95afa6d {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:39:37.529665 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Acquiring lock "3dd6ac52-de12-47da-bc90-77d0fff44acf-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:37.529665 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lock "3dd6ac52-de12-47da-bc90-77d0fff44acf-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:37.529665 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lock "3dd6ac52-de12-47da-bc90-77d0fff44acf-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:37.529665 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-739986196',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-serveractionsv293testjson-server-739986196',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpC408hAS7ZHCLcxOORErGa34r6kFwvPfr3Lp/mseMBy2poBV1dMkTaNTtK74/pNLf0Wh6LpCI1nkrL/Xs5OehD5/80bs1kvQaAe6W4GP47k+Sfo1MyP9GisRKDNYuUyg==',key_name='tempest-keypair-400928869',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='40a4e84471c94128b1ac4dd00ca7177b',ramdisk_id='',reservation_id='r-c2y3fxk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerActionsV293TestJSON-1674673586',owner_user_name='tempest-ServerActionsV293TestJSON-1674673586-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:39:29Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11ad63f2d09c4e7dac51c03de3a31f4a',uuid=3dd6ac52-de12-47da-bc90-77d0fff44acf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "address": "fa:16:3e:41:2f:75", "network": {"id": "66d12b1b-32f2-4152-b44c-13e5284b49f9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-186021134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a4e84471c94128b1ac4dd00ca7177b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap288e6be4-7a", "ovs_interfaceid": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:39:37.529665 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Converting VIF {"id": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "address": "fa:16:3e:41:2f:75", "network": {"id": "66d12b1b-32f2-4152-b44c-13e5284b49f9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-186021134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a4e84471c94128b1ac4dd00ca7177b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap288e6be4-7a", "ovs_interfaceid": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:39:37.529665 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:41:2f:75,bridge_name='br-int',has_traffic_filtering=True,id=288e6be4-7ae8-4847-ad8e-a0b0b95afa6d,network=Network(66d12b1b-32f2-4152-b44c-13e5284b49f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap288e6be4-7a') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:39:37.530188 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:2f:75,bridge_name='br-int',has_traffic_filtering=True,id=288e6be4-7ae8-4847-ad8e-a0b0b95afa6d,network=Network(66d12b1b-32f2-4152-b44c-13e5284b49f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap288e6be4-7a') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:39:37.530323 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:37.530666 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:37.530997 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:39:37.532857 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:37.533126 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd06ecd5e-65e6-577c-8e70-2a0d4be3317d', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:37.534840 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:37.534910 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:39:37.542227 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:37.543697 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:37.543966 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap288e6be4-7a, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:37.544370 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap288e6be4-7a, col_values=(('qos', UUID('13c5dcd5-f247-4ffe-a90d-b175ea904d43')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:37.544586 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap288e6be4-7a, col_values=(('external_ids', {'iface-id': '288e6be4-7ae8-4847-ad8e-a0b0b95afa6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:2f:75', 'vm-uuid': '3dd6ac52-de12-47da-bc90-77d0fff44acf'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:37.545944 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:37.547204 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:39:37.559921 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:37.561224 np0000003731 nova-compute[98967]: INFO os_vif [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:41:2f:75,bridge_name='br-int',has_traffic_filtering=True,id=288e6be4-7ae8-4847-ad8e-a0b0b95afa6d,network=Network(66d12b1b-32f2-4152-b44c-13e5284b49f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap288e6be4-7a') Jun 26 10:39:37.650832 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/a96a5f9c05fe6213d0b75523854344c6272ea3c3.part /opt/stack/data/nova/instances/_base/a96a5f9c05fe6213d0b75523854344c6272ea3c3.converted" returned: 0 in 0.168s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:37.656204 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a96a5f9c05fe6213d0b75523854344c6272ea3c3.converted --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:37.741052 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a96a5f9c05fe6213d0b75523854344c6272ea3c3.converted --force-share --output=json" returned: 0 in 0.085s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:37.743724 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "a96a5f9c05fe6213d0b75523854344c6272ea3c3" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.139s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:37.744278 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:39:37.751998 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:39:37.755483 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "a96a5f9c05fe6213d0b75523854344c6272ea3c3" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:37.756071 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "a96a5f9c05fe6213d0b75523854344c6272ea3c3" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:37.756687 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:39:37.760776 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:39:37.761662 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a96a5f9c05fe6213d0b75523854344c6272ea3c3 --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:37.798045 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98967) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 26 10:39:37.800422 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Allocating IP information in the background. {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 26 10:39:37.800422 np0000003731 nova-compute[98967]: INFO nova.compute.claims [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Claim successful on node np0000003731 Jun 26 10:39:37.807559 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] allocate_for_instance() {{(pid=98967) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 26 10:39:37.808334 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:37.808863 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:37.867314 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/a96a5f9c05fe6213d0b75523854344c6272ea3c3 --force-share --output=json" returned: 0 in 0.106s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:37.867887 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a96a5f9c05fe6213d0b75523854344c6272ea3c3,backing_fmt=raw /opt/stack/data/nova/instances/b53c3532-08c2-4c05-b5e5-c217d3ef4d9a/disk.rescue {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:37.904118 np0000003731 nova-compute[98967]: DEBUG nova.policy [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2182fde17d0f447c971e388b65911648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d10b4c2e162455786d5aa40d72a31c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98967) authorize /opt/stack/nova/nova/policy.py:192}} Jun 26 10:39:37.927549 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/a96a5f9c05fe6213d0b75523854344c6272ea3c3,backing_fmt=raw /opt/stack/data/nova/instances/b53c3532-08c2-4c05-b5e5-c217d3ef4d9a/disk.rescue" returned: 0 in 0.059s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:37.927994 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "a96a5f9c05fe6213d0b75523854344c6272ea3c3" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.172s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:37.928368 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lazy-loading 'migration_context' on Instance uuid b53c3532-08c2-4c05-b5e5-c217d3ef4d9a {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:38.001095 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-0969fde2-dbd3-4d91-bd24-30aa6a5076cd req-8d3a4f63-4f1c-4412-bde3-2244ebd01082 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:38.285159 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "c8aff61a-5f59-4f8c-8288-abd5a7853474" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:38.285713 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:38.285713 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Attaching volume bcbe644e-6829-4ba9-8208-ed82c54853b2 to /dev/vdb Jun 26 10:39:38.301933 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 26 10:39:38.318978 np0000003731 nova-compute[98967]: INFO nova.compute.resource_tracker [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Updating resource usage from migration e32c4165-65b0-4a56-8723-54a78d880640 Jun 26 10:39:38.373604 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.79', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003731', 'execute': None}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:39:38.380605 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-0969fde2-dbd3-4d91-bd24-30aa6a5076cd req-8d3a4f63-4f1c-4412-bde3-2244ebd01082 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:38.392966 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.scaleio [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98967) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 10:39:38.428170 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Running cmd (subprocess): nvme version {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:38.458403 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:39:38.458403 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Created local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 26 10:39:38.458403 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Start _get_guest_xml network_info=[{"id": "43cc3477-2288-4c03-8374-5701e3d3baa1", "address": "fa:16:3e:0e:19:b0", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "vif_mac": "fa:16:3e:0e:19:b0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43cc3477-22", "ovs_interfaceid": "43cc3477-2288-4c03-8374-5701e3d3baa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}, 'disk.rescue': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=) rescue={'image_id': '986bcae6-4242-40d2-a0e4-752b5cbc4a47', 'kernel_id': '', 'ramdisk_id': ''} block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc71798f-22b5-44d3-8fac-77084df22f84', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}, 'status': 'reserved', 'instance': 'b53c3532-08c2-4c05-b5e5-c217d3ef4d9a', 'attached_at': '', 'detached_at': '', 'volume_id': 'dc71798f-22b5-44d3-8fac-77084df22f84', 'serial': 'dc71798f-22b5-44d3-8fac-77084df22f84'}, 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '2424ac2f-79f2-4a0b-bbdc-ce1c7ad3cdb1', 'volume_type': None}], 'swap': None}share_info=ShareMappingList(objects=[]) {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:39:38.458403 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lazy-loading 'resources' on Instance uuid b53c3532-08c2-4c05-b5e5-c217d3ef4d9a {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:38.493138 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] 'nvme version' failed. Not Retrying. {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 10:39:38.494035 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.nvmeof [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] nvme not present on system {{(pid=98967) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 10:39:38.505895 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98967) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 10:39:38.507844 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.lightos [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Current host hostNQN and IP(s) are ['10.4.3.79', 'fe80::f816:3eff:fe55:ba34', '192.168.40.6', 'fe80::f816:3eff:fe6b:fe1a', '192.168.50.6', 'fe80::f816:3eff:feca:9cd0', '192.168.10.6', 'fe80::f816:3eff:feb4:4e78', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f8bb:38ff:fe28:ff4a', 'fe80::fc16:3eff:fe37:b3f6', 'fe80::41a:feff:fe02:479d', 'fe80::fc16:3eff:fe5e:459', 'fe80::fc16:3eff:fe90:be9c', 'fe80::84cb:23ff:fe8e:e6e6', 'fe80::fc16:3eff:fe5a:811a', 'fe80::fc16:3eff:fe1b:5509', 'fe80::fc16:3eff:fe48:bca4', 'fe80::fc16:3eff:fef2:781c', 'fe80::b448:c6ff:fe9c:a1e9', 'fe80::fc16:3eff:fe78:446c', 'fe80::fc16:3eff:fe43:d828', 'fe80::fc16:3eff:fe9c:6906', 'fe80::bc5e:80ff:fe69:218d', 'fe80::fc16:3eff:fefd:1020', 'fe80::fc16:3eff:fe17:f5ed', 'fe80::e4d7:e7ff:fe80:d900', 'fe80::fc16:3eff:feec:35bf', 'fe80::fc16:3eff:fe52:9c9b', 'fe80::fc16:3eff:feac:bc0b', 'fe80::fc16:3eff:feb3:64e7', 'fe80::fc16:3eff:fe6a:a465', 'fe80::6cd3:9eff:fe53:c46c', 'fe80::bc4e:7ff:fef8:a00a', 'fe80::fc16:3eff:fe97:321f', 'fe80::1cb1:31ff:fe57:6a2'] Jun 26 10:39:38.508063 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 10:39:38.508202 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] LIGHTOS: no hostnqn found. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 10:39:38.508596 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] <== get_connector_properties: return (134ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.79', 'host': 'np0000003731', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:2fddcc2116d6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '7f2a0776-2f14-4357-a22e-baa6677eb22e', 'nvme_native_multipath': False} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:39:38.508900 np0000003731 nova-compute[98967]: DEBUG nova.virt.block_device [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Updating existing volume attachment record: caed631f-a827-485f-a645-77d79c72a5eb {{(pid=98967) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 26 10:39:38.599833 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Successfully created port: 0825879a-7c75-4a22-b61e-d9289b60926b {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:39:38.623117 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-0969fde2-dbd3-4d91-bd24-30aa6a5076cd req-8d3a4f63-4f1c-4412-bde3-2244ebd01082 service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Updated VIF entry in instance network info cache for port 603c0b2c-d13b-48d6-a1a0-77c17c62c23e. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:39:38.623756 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-0969fde2-dbd3-4d91-bd24-30aa6a5076cd req-8d3a4f63-4f1c-4412-bde3-2244ebd01082 service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Updating instance_info_cache with network_info: [{"id": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "address": "fa:16:3e:97:32:1f", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap603c0b2c-d1", "ovs_interfaceid": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:39:38.808302 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Start building block device mappings for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 26 10:39:38.973778 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:39:38.978678 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:39:38.979735 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-1292545386', uuid='b53c3532-08c2-4c05-b5e5-c217d3ef4d9a'), owner=OwnerMeta(userid='72704c563abb412aa2c238092bd55ec4', username='tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member', projectid='ea834a26efe148649425d3e02d974ef4', projectname='tempest-ServerBootFromVolumeStableRescueTest-618712607'), image=ImageMeta(id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "43cc3477-2288-4c03-8374-5701e3d3baa1", "address": "fa:16:3e:0e:19:b0", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "vif_mac": "fa:16:3e:0e:19:b0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43cc3477-22", "ovs_interfaceid": "43cc3477-2288-4c03-8374-5701e3d3baa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470378.9789538) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:39:38.983800 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:39:38.983800 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:39:38.986531 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:39:38.986531 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:39:38.986909 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:39:38.987433 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:39:38.989294 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:39:38.989294 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:39:38.989545 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:39:38.989977 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:39:38.989977 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:39:38.990262 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:39:38.990912 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:39:38.990912 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:39:38.990912 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:39:38.990912 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:39:38.998186 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lazy-loading 'vcpu_model' on Instance uuid b53c3532-08c2-4c05-b5e5-c217d3ef4d9a {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:39.090562 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:39:39.094065 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:39:39.094065 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] No VIF found with MAC fa:16:3e:41:2f:75, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:39:39.094065 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Using config drive Jun 26 10:39:39.120123 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Calling os-brick to attach iSCSI Volume {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 26 10:39:39.120123 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2', 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcbe644e-6829-4ba9-8208-ed82c54853b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:39:39.120123 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:39.120123 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:39.120123 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2', 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcbe644e-6829-4ba9-8208-ed82c54853b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 10:39:39.127059 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-0969fde2-dbd3-4d91-bd24-30aa6a5076cd req-8d3a4f63-4f1c-4412-bde3-2244ebd01082 service nova] Releasing lock "refresh_cache-edf92675-15b4-424f-85b5-80341e77b578" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:39:39.133444 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:39.135213 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:39.135213 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:39.135213 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:39:39.135213 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:39.135213 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:39:39.150050 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:39:39.150050 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:39.156189 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:39:39.156189 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:39.165310 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2] added Jun 26 10:39:39.165310 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:39:39.165310 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:39:39.165310 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:39:39.165310 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:39:39.165310 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:39:39.165310 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:39.165310 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:39:39.165310 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0289(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:39:39.165310 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:39:39.184480 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2] added Jun 26 10:39:39.184480 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:39:39.184480 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:39:39.184480 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:39:39.184480 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:39:39.184480 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:39:39.184480 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:39.186446 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:39:39.186446 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0496(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:39:39.186446 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:39:39.405876 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:39:39.406303 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:39:39.460693 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Successfully updated port: 0825879a-7c75-4a22-b61e-d9289b60926b {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:39:39.493427 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:39:39.504599 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b53c3532-08c2-4c05-b5e5-c217d3ef4d9a/disk.config --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:39.599734 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:39.606163 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/b53c3532-08c2-4c05-b5e5-c217d3ef4d9a/disk.config --force-share --output=json" returned: 0 in 0.101s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:39.606603 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "/opt/stack/data/nova/instances/b53c3532-08c2-4c05-b5e5-c217d3ef4d9a/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:39.607073 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "/opt/stack/data/nova/instances/b53c3532-08c2-4c05-b5e5-c217d3ef4d9a/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:39.607573 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "/opt/stack/data/nova/instances/b53c3532-08c2-4c05-b5e5-c217d3ef4d9a/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:39.607829 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Calling os-brick to attach iSCSI Volume {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 26 10:39:39.608250 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc71798f-22b5-44d3-8fac-77084df22f84', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:39:39.610455 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:39.612340 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-1f8255b1-1a8a-4a74-ba96-88ecde36cb78 req-ee4b3836-bc98-4569-8431-6f5758f03eda service nova] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Received event network-changed-0825879a-7c75-4a22-b61e-d9289b60926b {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:39.613913 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-1f8255b1-1a8a-4a74-ba96-88ecde36cb78 req-ee4b3836-bc98-4569-8431-6f5758f03eda service nova] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Refreshing instance network info cache due to event network-changed-0825879a-7c75-4a22-b61e-d9289b60926b. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:39:39.614110 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-1f8255b1-1a8a-4a74-ba96-88ecde36cb78 req-ee4b3836-bc98-4569-8431-6f5758f03eda service nova] Acquiring lock "refresh_cache-619d915a-12c9-424f-8c12-b2a3f94a4109" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:39:39.614312 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-1f8255b1-1a8a-4a74-ba96-88ecde36cb78 req-ee4b3836-bc98-4569-8431-6f5758f03eda service nova] Acquired lock "refresh_cache-619d915a-12c9-424f-8c12-b2a3f94a4109" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:39:39.614426 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-1f8255b1-1a8a-4a74-ba96-88ecde36cb78 req-ee4b3836-bc98-4569-8431-6f5758f03eda service nova] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Refreshing network info cache for port 0825879a-7c75-4a22-b61e-d9289b60926b {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:39:39.755763 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Creating config drive at /opt/stack/data/nova/instances/3dd6ac52-de12-47da-bc90-77d0fff44acf/disk.config Jun 26 10:39:39.763695 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3dd6ac52-de12-47da-bc90-77d0fff44acf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphqlq1vgz {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:39.814552 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3dd6ac52-de12-47da-bc90-77d0fff44acf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmphqlq1vgz" returned: 0 in 0.050s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:39.821241 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Start spawning the instance on the hypervisor. {{(pid=98967) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 26 10:39:39.828157 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Creating instance directory {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 26 10:39:39.828467 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Creating image(s) Jun 26 10:39:39.829105 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Acquiring lock "/opt/stack/data/nova/instances/619d915a-12c9-424f-8c12-b2a3f94a4109/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:39.829339 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lock "/opt/stack/data/nova/instances/619d915a-12c9-424f-8c12-b2a3f94a4109/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:39.829823 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lock "/opt/stack/data/nova/instances/619d915a-12c9-424f-8c12-b2a3f94a4109/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:39.833564 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:39:39.839103 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:39:39.841567 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:39.910068 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:39:39.934591 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.093s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:39.935227 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Acquiring lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:39.935746 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:39.936294 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:39:39.940845 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:39:39.941485 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:39.965175 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Acquiring lock "refresh_cache-619d915a-12c9-424f-8c12-b2a3f94a4109" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:39:40.033378 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.092s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:40.033756 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/619d915a-12c9-424f-8c12-b2a3f94a4109/disk 1073741824 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:40.100235 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/619d915a-12c9-424f-8c12-b2a3f94a4109/disk 1073741824" returned: 0 in 0.066s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:40.100779 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.165s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:40.101165 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:40.118428 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-1f8255b1-1a8a-4a74-ba96-88ecde36cb78 req-ee4b3836-bc98-4569-8431-6f5758f03eda service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:40.166172 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.40.100 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:39:40.182143 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:40.188172 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:39:40.188736 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.087s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:40.189738 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Checking if we can resize image /opt/stack/data/nova/instances/619d915a-12c9-424f-8c12-b2a3f94a4109/disk. size=1073741824 {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 26 10:39:40.189738 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/619d915a-12c9-424f-8c12-b2a3f94a4109/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:40.203919 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.50.100 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:39:40.206844 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:40.213049 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-1f8255b1-1a8a-4a74-ba96-88ecde36cb78 req-ee4b3836-bc98-4569-8431-6f5758f03eda service nova] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:39:40.225838 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:40.225838 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:40.225838 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:40.225838 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:40.225838 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:40.225838 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:40.225838 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:40.225838 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:40.225838 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:40.225838 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:40.225838 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:40.225838 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:40.225838 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:40.225838 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:40.225838 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:40.226885 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:40.226885 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:40.226885 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:40.226885 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:40.226885 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:40.226885 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:40.226885 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:40.226885 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:40.226885 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:40.226885 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:40.226885 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:40.226885 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:40.226885 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:40.226885 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:40.226885 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:40.234130 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:40.259640 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:40.259640 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:40.259640 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:40.259640 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:40.259640 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:40.259640 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:40.259640 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:40.259640 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:40.259640 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:40.259640 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:40.259640 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:40.259640 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:40.259640 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:40.259640 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:40.259640 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:40.259640 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:40.259640 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:40.259640 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:40.259640 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:40.259640 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:40.259640 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:40.259640 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:40.259640 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:40.259640 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:40.259640 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:40.259640 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:40.259640 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:40.259640 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:40.259640 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:40.259640 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:40.290607 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/619d915a-12c9-424f-8c12-b2a3f94a4109/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:40.291499 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Cannot resize image /opt/stack/data/nova/instances/619d915a-12c9-424f-8c12-b2a3f94a4109/disk to a smaller size. {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 26 10:39:40.291605 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Created local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 26 10:39:40.291905 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Ensure instance console log exists: /opt/stack/data/nova/instances/619d915a-12c9-424f-8c12-b2a3f94a4109/console.log {{(pid=98967) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 26 10:39:40.292247 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:40.292469 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:40.292638 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:40.299581 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2, portal: 192.168.40.100,3260] Jun 26 10:39:40.299581 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2, portal: 192.168.40.100,3260] successful. Jun 26 10:39:40.299581 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:40.303212 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:40.333494 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:40.360589 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:40.363688 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:40.363688 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:40.363688 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:40.363688 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:40.363688 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:40.363688 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:40.363688 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:40.363688 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:40.363688 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:40.363688 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:40.363688 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:40.363688 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:40.363688 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:40.363688 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:40.363688 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:39:40.363688 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:40.364578 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:40.364578 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:40.364578 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:40.364578 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:40.364578 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:40.364578 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:40.364578 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:40.364578 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:40.364578 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:40.364578 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:40.364578 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:40.364578 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:40.364578 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:40.364578 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:40.364578 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:39:40.364578 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:40.369777 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.233s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:39:40.370464 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Connected to 192.168.40.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:39:40.372435 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2, portal: 192.168.50.100,3260] Jun 26 10:39:40.372435 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2, portal: 192.168.50.100,3260] successful. Jun 26 10:39:40.372435 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:40.373811 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] HCTL ('21', '-', '-', 0) found on session 34 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:39:40.373811 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Scanning host 21 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:39:40.387660 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:40.416101 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Searching for a device in session 34 and hctl ['21', '*', '*', 0] yield: sdp {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:39:40.416101 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Connected to sdp using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcbe644e-6829-4ba9-8208-ed82c54853b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:39:40.421201 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:40.422173 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.287s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:39:40.422173 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Connected to 192.168.50.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:39:40.424202 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 3.141s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:40.424382 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Migrating Jun 26 10:39:40.424565 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "compute-rpcapi-router" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:39:40.424686 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquired lock "compute-rpcapi-router" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:39:40.431823 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] HCTL ('22', '-', '-', 0) found on session 35 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:39:40.431995 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Scanning host 22 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:39:40.548301 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-1f8255b1-1a8a-4a74-ba96-88ecde36cb78 req-ee4b3836-bc98-4569-8431-6f5758f03eda service nova] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:39:40.548301 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:40.558807 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Searching for a device in session 35 and hctl ['22', '*', '*', 0] yield: sdq {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:39:40.558807 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Connected to sdq using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'bcbe644e-6829-4ba9-8208-ed82c54853b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:39:40.644427 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-53670ec1-bb96-4495-ae93-eaa956760746 req-46653932-b3c3-4640-9a59-03e18e88a6c1 service nova] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Received event network-vif-plugged-288e6be4-7ae8-4847-ad8e-a0b0b95afa6d {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:40.644427 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-53670ec1-bb96-4495-ae93-eaa956760746 req-46653932-b3c3-4640-9a59-03e18e88a6c1 service nova] Acquiring lock "3dd6ac52-de12-47da-bc90-77d0fff44acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:40.644748 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-53670ec1-bb96-4495-ae93-eaa956760746 req-46653932-b3c3-4640-9a59-03e18e88a6c1 service nova] Lock "3dd6ac52-de12-47da-bc90-77d0fff44acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:40.644748 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-53670ec1-bb96-4495-ae93-eaa956760746 req-46653932-b3c3-4640-9a59-03e18e88a6c1 service nova] Lock "3dd6ac52-de12-47da-bc90-77d0fff44acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:40.645168 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-53670ec1-bb96-4495-ae93-eaa956760746 req-46653932-b3c3-4640-9a59-03e18e88a6c1 service nova] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Processing event network-vif-plugged-288e6be4-7ae8-4847-ad8e-a0b0b95afa6d {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:39:40.769941 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:40.778683 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:40.786550 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:40.810744 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:40.817288 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:40.930923 np0000003731 nova-compute[98967]: INFO nova.compute.rpcapi [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Automatically selected compute RPC version 6.5 from minimum service version 72 Jun 26 10:39:40.931579 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Releasing lock "compute-rpcapi-router" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:39:40.931811 np0000003731 nova-compute[98967]: DEBUG nova.compute.rpcapi [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98967) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 26 10:39:40.994412 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-1f8255b1-1a8a-4a74-ba96-88ecde36cb78 req-ee4b3836-bc98-4569-8431-6f5758f03eda service nova] Releasing lock "refresh_cache-619d915a-12c9-424f-8c12-b2a3f94a4109" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:39:40.995433 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Acquired lock "refresh_cache-619d915a-12c9-424f-8c12-b2a3f94a4109" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:39:40.995659 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:39:41.135379 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 26 10:39:41.407897 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:39:41.408434 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:39:41.408656 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] VM Started (Lifecycle Event) Jun 26 10:39:41.410980 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Guest created on hypervisor {{(pid=98967) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 26 10:39:41.414940 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Instance spawned successfully. Jun 26 10:39:41.415582 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 26 10:39:41.454796 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "refresh_cache-c1043abd-b0c0-439e-b065-8bef627483cb" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:39:41.455296 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquired lock "refresh_cache-c1043abd-b0c0-439e-b065-8bef627483cb" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:39:41.455296 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:39:41.582408 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:39:41.779667 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:41.911584 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:41.913889 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:39:41.923669 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Found default for hw_cdrom_bus of ide {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:41.923877 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Found default for hw_disk_bus of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:41.924452 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Found default for hw_input_bus of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:41.924798 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Found default for hw_pointer_model of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:41.925271 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Found default for hw_video_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:41.925661 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Found default for hw_vif_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:41.943633 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Updating instance_info_cache with network_info: [{"id": "0825879a-7c75-4a22-b61e-d9289b60926b", "address": "fa:16:3e:a4:49:e7", "network": {"id": "9d61e079-8b68-4387-9c86-1e9172058c20", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-936629968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d10b4c2e162455786d5aa40d72a31c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0825879a-7c", "ovs_interfaceid": "0825879a-7c75-4a22-b61e-d9289b60926b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:39:41.957517 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:42.164302 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Found WWN 3300000008026e2de for multipath device dm-13 {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 26 10:39:42.164302 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.041s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:39:42.164302 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] <== connect_volume: return (3042ms) {'type': 'block', 'scsi_wwn': '3300000008026e2de', 'path': '/dev/dm-13', 'multipath_id': '3300000008026e2de'} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:39:42.164302 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008026e2de', 'path': '/dev/dm-13', 'multipath_id': '3300000008026e2de'} {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 26 10:39:42.164302 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.553s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:42.164302 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc71798f-22b5-44d3-8fac-77084df22f84', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'} {{(pid=98967) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 10:39:42.168089 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'flavor' on Instance uuid c8aff61a-5f59-4f8c-8288-abd5a7853474 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:42.178570 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:42.179196 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:42.179458 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:39:42.180709 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:42.180906 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:42.181207 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.startup = automatic Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.session.scan = manual Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.40.100 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:39:42.201685 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.startup = automatic Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.session.scan = manual Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.50.100 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:39:42.206240 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:42.216567 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:42.224941 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:39:42.240153 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:42.240947 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.061s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:39:42.240947 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Connected to 192.168.40.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:39:42.241761 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] HCTL ('17', '0', '0', 0) found on session 30 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:39:42.241761 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Scanning host 17 c: 0, t: 0, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:39:42.253532 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Searching for a device in session 30 and hctl ('17', '0', '0', 0) yield: sdl {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:39:42.253757 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Connected to sdl using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'dc71798f-22b5-44d3-8fac-77084df22f84', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:39:42.258678 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:42.259429 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.078s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:39:42.259429 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Connected to 192.168.50.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:39:42.260331 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] HCTL ('18', '0', '0', 0) found on session 31 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:39:42.260477 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Scanning host 18 c: 0, t: 0, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:39:42.272992 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Searching for a device in session 31 and hctl ('18', '0', '0', 0) yield: sdm {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:39:42.273275 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Connected to sdm using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'dc71798f-22b5-44d3-8fac-77084df22f84', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-9'} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:39:42.383507 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:42.416650 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] During sync_power_state the instance has a pending task (spawning). Skip. Jun 26 10:39:42.416902 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Paused> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:39:42.417177 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] VM Paused (Lifecycle Event) Jun 26 10:39:42.432379 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Took 10.31 seconds to spawn the instance on the hypervisor. Jun 26 10:39:42.432697 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:42.446270 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Releasing lock "refresh_cache-619d915a-12c9-424f-8c12-b2a3f94a4109" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:39:42.446639 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Instance network_info: |[{"id": "0825879a-7c75-4a22-b61e-d9289b60926b", "address": "fa:16:3e:a4:49:e7", "network": {"id": "9d61e079-8b68-4387-9c86-1e9172058c20", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-936629968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d10b4c2e162455786d5aa40d72a31c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0825879a-7c", "ovs_interfaceid": "0825879a-7c75-4a22-b61e-d9289b60926b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 26 10:39:42.450204 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Start _get_guest_xml network_info=[{"id": "0825879a-7c75-4a22-b61e-d9289b60926b", "address": "fa:16:3e:a4:49:e7", "network": {"id": "9d61e079-8b68-4387-9c86-1e9172058c20", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-936629968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d10b4c2e162455786d5aa40d72a31c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0825879a-7c", "ovs_interfaceid": "0825879a-7c75-4a22-b61e-d9289b60926b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'image_id': 'a9b18127-6fee-4ed6-b364-a2d634ecb8b7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:39:42.459412 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:39:42.460664 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1329602566', uuid='619d915a-12c9-424f-8c12-b2a3f94a4109'), owner=OwnerMeta(userid='2182fde17d0f447c971e388b65911648', username='tempest-TaggedAttachmentsTest-1829838869-project-member', projectid='4d10b4c2e162455786d5aa40d72a31c7', projectname='tempest-TaggedAttachmentsTest-1829838869'), image=ImageMeta(id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0825879a-7c75-4a22-b61e-d9289b60926b", "address": "fa:16:3e:a4:49:e7", "network": {"id": "9d61e079-8b68-4387-9c86-1e9172058c20", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-936629968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d10b4c2e162455786d5aa40d72a31c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0825879a-7c", "ovs_interfaceid": "0825879a-7c75-4a22-b61e-d9289b60926b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470382.4602137) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:39:42.462116 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:39:42.462618 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:39:42.464575 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:39:42.464575 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:39:42.465830 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:39:42.466397 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:39:42.466578 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:39:42.466712 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:39:42.467911 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:39:42.467911 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:39:42.467911 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:39:42.467911 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:39:42.467911 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:39:42.467911 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:39:42.467911 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:39:42.469597 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:39:42.480729 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:39:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1329602566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-1329602566',id=23,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPv9SUt9TdjN5OZ4Ypk2xTwDqORSk7I6hErYKR7wNppYsK22T4j5VWZStNGf7JdUDmoiKJG45UqJOBREGbXYHEWrXxZJ7lAQaFPzSP5N0HdEGBWxH/KmemEWI0PPG+MHA==',key_name='tempest-keypair-1334314580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d10b4c2e162455786d5aa40d72a31c7',ramdisk_id='',reservation_id='r-dhr2xu20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1829838869',owner_user_name='tempest-TaggedAttachmentsTest-1829838869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:39:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2182fde17d0f447c971e388b65911648',uuid=619d915a-12c9-424f-8c12-b2a3f94a4109,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0825879a-7c75-4a22-b61e-d9289b60926b", "address": "fa:16:3e:a4:49:e7", "network": {"id": "9d61e079-8b68-4387-9c86-1e9172058c20", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-936629968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d10b4c2e162455786d5aa40d72a31c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0825879a-7c", "ovs_interfaceid": "0825879a-7c75-4a22-b61e-d9289b60926b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:39:42.480961 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Converting VIF {"id": "0825879a-7c75-4a22-b61e-d9289b60926b", "address": "fa:16:3e:a4:49:e7", "network": {"id": "9d61e079-8b68-4387-9c86-1e9172058c20", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-936629968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d10b4c2e162455786d5aa40d72a31c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0825879a-7c", "ovs_interfaceid": "0825879a-7c75-4a22-b61e-d9289b60926b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:39:42.481677 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:49:e7,bridge_name='br-int',has_traffic_filtering=True,id=0825879a-7c75-4a22-b61e-d9289b60926b,network=Network(9d61e079-8b68-4387-9c86-1e9172058c20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0825879a-7c') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:39:42.482601 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lazy-loading 'pci_devices' on Instance uuid 619d915a-12c9-424f-8c12-b2a3f94a4109 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:42.517961 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:42.545998 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:42.588334 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Updating instance_info_cache with network_info: [{"id": "061a7108-6f47-4def-b12d-38eb13d382f6", "address": "fa:16:3e:48:bc:a4", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap061a7108-6f", "ovs_interfaceid": "061a7108-6f47-4def-b12d-38eb13d382f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:39:42.671662 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Attempting to attach volume bcbe644e-6829-4ba9-8208-ed82c54853b2 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98967) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 26 10:39:42.673135 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] attach device xml: Jun 26 10:39:42.673135 np0000003731 nova-compute[98967]: Jun 26 10:39:42.673135 np0000003731 nova-compute[98967]: Jun 26 10:39:42.673135 np0000003731 nova-compute[98967]: Jun 26 10:39:42.673135 np0000003731 nova-compute[98967]: Jun 26 10:39:42.673135 np0000003731 nova-compute[98967]: bcbe644e-6829-4ba9-8208-ed82c54853b2 Jun 26 10:39:42.673135 np0000003731 nova-compute[98967]: Jun 26 10:39:42.673135 np0000003731 nova-compute[98967]: {{(pid=98967) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 26 10:39:42.719165 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-9b5a63f7-9c7f-4d3b-ae3a-4b0552b93fbd req-4d2c9d28-92b0-4463-946a-cace54f40d0d service nova] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Received event network-vif-plugged-288e6be4-7ae8-4847-ad8e-a0b0b95afa6d {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:42.719726 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-9b5a63f7-9c7f-4d3b-ae3a-4b0552b93fbd req-4d2c9d28-92b0-4463-946a-cace54f40d0d service nova] Acquiring lock "3dd6ac52-de12-47da-bc90-77d0fff44acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:42.719726 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-9b5a63f7-9c7f-4d3b-ae3a-4b0552b93fbd req-4d2c9d28-92b0-4463-946a-cace54f40d0d service nova] Lock "3dd6ac52-de12-47da-bc90-77d0fff44acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:42.722310 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-9b5a63f7-9c7f-4d3b-ae3a-4b0552b93fbd req-4d2c9d28-92b0-4463-946a-cace54f40d0d service nova] Lock "3dd6ac52-de12-47da-bc90-77d0fff44acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:42.722310 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-9b5a63f7-9c7f-4d3b-ae3a-4b0552b93fbd req-4d2c9d28-92b0-4463-946a-cace54f40d0d service nova] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] No waiting events found dispatching network-vif-plugged-288e6be4-7ae8-4847-ad8e-a0b0b95afa6d {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:39:42.722310 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-9b5a63f7-9c7f-4d3b-ae3a-4b0552b93fbd req-4d2c9d28-92b0-4463-946a-cace54f40d0d service nova] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Received unexpected event network-vif-plugged-288e6be4-7ae8-4847-ad8e-a0b0b95afa6d for instance with vm_state active and task_state None. Jun 26 10:39:42.920798 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:42.925468 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:39:42.925655 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] VM Resumed (Lifecycle Event) Jun 26 10:39:42.946385 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Took 21.99 seconds to build instance. Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] End _get_guest_xml xml= Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: 619d915a-12c9-424f-8c12-b2a3f94a4109 Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: instance-00000017 Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: 196608 Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: tempest-device-tagging-server-1329602566 Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: 2026-06-26 10:39:42 Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: 192 Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: 0 Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: 0 Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: True Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: bare Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: 0 Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: virtio Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: tempest-TaggedAttachmentsTest-1829838869-project-member Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: tempest-TaggedAttachmentsTest-1829838869 Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: 619d915a-12c9-424f-8c12-b2a3f94a4109 Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: 619d915a-12c9-424f-8c12-b2a3f94a4109 Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: hvm Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: 128 Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: Jun 26 10:39:42.986081 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:39:42.988730 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Preparing to wait for external event network-vif-plugged-0825879a-7c75-4a22-b61e-d9289b60926b {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:39:42.988730 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Acquiring lock "619d915a-12c9-424f-8c12-b2a3f94a4109-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:42.988730 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lock "619d915a-12c9-424f-8c12-b2a3f94a4109-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:42.988730 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lock "619d915a-12c9-424f-8c12-b2a3f94a4109-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:42.988730 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:39:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1329602566',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-1329602566',id=23,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPv9SUt9TdjN5OZ4Ypk2xTwDqORSk7I6hErYKR7wNppYsK22T4j5VWZStNGf7JdUDmoiKJG45UqJOBREGbXYHEWrXxZJ7lAQaFPzSP5N0HdEGBWxH/KmemEWI0PPG+MHA==',key_name='tempest-keypair-1334314580',keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='4d10b4c2e162455786d5aa40d72a31c7',ramdisk_id='',reservation_id='r-dhr2xu20',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-TaggedAttachmentsTest-1829838869',owner_user_name='tempest-TaggedAttachmentsTest-1829838869-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:39:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2182fde17d0f447c971e388b65911648',uuid=619d915a-12c9-424f-8c12-b2a3f94a4109,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "0825879a-7c75-4a22-b61e-d9289b60926b", "address": "fa:16:3e:a4:49:e7", "network": {"id": "9d61e079-8b68-4387-9c86-1e9172058c20", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-936629968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d10b4c2e162455786d5aa40d72a31c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0825879a-7c", "ovs_interfaceid": "0825879a-7c75-4a22-b61e-d9289b60926b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:39:42.988730 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Converting VIF {"id": "0825879a-7c75-4a22-b61e-d9289b60926b", "address": "fa:16:3e:a4:49:e7", "network": {"id": "9d61e079-8b68-4387-9c86-1e9172058c20", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-936629968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d10b4c2e162455786d5aa40d72a31c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0825879a-7c", "ovs_interfaceid": "0825879a-7c75-4a22-b61e-d9289b60926b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:39:42.989939 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:a4:49:e7,bridge_name='br-int',has_traffic_filtering=True,id=0825879a-7c75-4a22-b61e-d9289b60926b,network=Network(9d61e079-8b68-4387-9c86-1e9172058c20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0825879a-7c') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:39:42.989939 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:49:e7,bridge_name='br-int',has_traffic_filtering=True,id=0825879a-7c75-4a22-b61e-d9289b60926b,network=Network(9d61e079-8b68-4387-9c86-1e9172058c20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0825879a-7c') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:39:42.989939 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:42.990213 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:42.990482 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:39:42.992624 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:42.993047 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '4fd9b3d5-585d-51f3-818e-929eac8b807b', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:42.994472 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:42.995167 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:39:43.002953 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:43.006087 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:43.006345 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap0825879a-7c, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:43.006717 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap0825879a-7c, col_values=(('qos', UUID('8e654bce-4878-443f-bb83-c8a1fa6683b4')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:43.006900 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap0825879a-7c, col_values=(('external_ids', {'iface-id': '0825879a-7c75-4a22-b61e-d9289b60926b', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:a4:49:e7', 'vm-uuid': '619d915a-12c9-424f-8c12-b2a3f94a4109'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:43.007937 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:43.010508 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:39:43.021287 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:43.022657 np0000003731 nova-compute[98967]: INFO os_vif [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:a4:49:e7,bridge_name='br-int',has_traffic_filtering=True,id=0825879a-7c75-4a22-b61e-d9289b60926b,network=Network(9d61e079-8b68-4387-9c86-1e9172058c20),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap0825879a-7c') Jun 26 10:39:43.090807 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Releasing lock "refresh_cache-c1043abd-b0c0-439e-b065-8bef627483cb" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:39:43.181347 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 26 10:39:43.428189 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:43.435759 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:39:43.448420 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-952b957a-c8f6-4de9-9bd4-3193134eb584 tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lock "3dd6ac52-de12-47da-bc90-77d0fff44acf" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 23.509s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:44.045330 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-5e3a1bbd-9f85-4275-8dd5-20ddf279ad30 req-66a6498c-f61d-464c-bf82-d5dfbf8cdbb3 service nova] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Received event network-changed-288e6be4-7ae8-4847-ad8e-a0b0b95afa6d {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:44.045721 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-5e3a1bbd-9f85-4275-8dd5-20ddf279ad30 req-66a6498c-f61d-464c-bf82-d5dfbf8cdbb3 service nova] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Refreshing instance network info cache due to event network-changed-288e6be4-7ae8-4847-ad8e-a0b0b95afa6d. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:39:44.045819 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5e3a1bbd-9f85-4275-8dd5-20ddf279ad30 req-66a6498c-f61d-464c-bf82-d5dfbf8cdbb3 service nova] Acquiring lock "refresh_cache-3dd6ac52-de12-47da-bc90-77d0fff44acf" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:39:44.046235 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5e3a1bbd-9f85-4275-8dd5-20ddf279ad30 req-66a6498c-f61d-464c-bf82-d5dfbf8cdbb3 service nova] Acquired lock "refresh_cache-3dd6ac52-de12-47da-bc90-77d0fff44acf" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:39:44.046235 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-5e3a1bbd-9f85-4275-8dd5-20ddf279ad30 req-66a6498c-f61d-464c-bf82-d5dfbf8cdbb3 service nova] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Refreshing network info cache for port 288e6be4-7ae8-4847-ad8e-a0b0b95afa6d {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:39:44.196446 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Found WWN 33000000081e8b8cb for multipath device dm-9 {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 26 10:39:44.197672 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 2.035s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:39:44.197672 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] <== connect_volume: return (4588ms) {'type': 'block', 'scsi_wwn': '33000000081e8b8cb', 'path': '/dev/dm-9', 'multipath_id': '33000000081e8b8cb'} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:39:44.197672 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '33000000081e8b8cb', 'path': '/dev/dm-9', 'multipath_id': '33000000081e8b8cb'} {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 26 10:39:44.362590 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:39:44.362765 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:39:44.362881 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:39:44.362980 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] No VIF found with MAC fa:16:3e:78:44:6c, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:39:44.558513 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-5e3a1bbd-9f85-4275-8dd5-20ddf279ad30 req-66a6498c-f61d-464c-bf82-d5dfbf8cdbb3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:44.565819 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:39:44.566085 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:39:44.566214 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] No VIF found with MAC fa:16:3e:a4:49:e7, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:39:44.566647 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Using config drive Jun 26 10:39:44.605487 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Starting migrate_disk_and_power_off {{(pid=98967) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12621}} Jun 26 10:39:44.655505 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:44.660364 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:44.688841 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:44.706737 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:39:04Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-1292545386',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-serverbootfromvolumestablerescuetest-server-1292545386',id=20,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=,launch_index=0,launched_at=2026-06-26T10:39:28Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='ea834a26efe148649425d3e02d974ef4',ramdisk_id='',reservation_id='r-j2neevza',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-618712607',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:39:29Z,user_data=None,user_id='72704c563abb412aa2c238092bd55ec4',uuid=b53c3532-08c2-4c05-b5e5-c217d3ef4d9a,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "43cc3477-2288-4c03-8374-5701e3d3baa1", "address": "fa:16:3e:0e:19:b0", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "vif_mac": "fa:16:3e:0e:19:b0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43cc3477-22", "ovs_interfaceid": "43cc3477-2288-4c03-8374-5701e3d3baa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:39:44.706737 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Converting VIF {"id": "43cc3477-2288-4c03-8374-5701e3d3baa1", "address": "fa:16:3e:0e:19:b0", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "vif_mac": "fa:16:3e:0e:19:b0"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43cc3477-22", "ovs_interfaceid": "43cc3477-2288-4c03-8374-5701e3d3baa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:39:44.706737 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:0e:19:b0,bridge_name='br-int',has_traffic_filtering=True,id=43cc3477-2288-4c03-8374-5701e3d3baa1,network=Network(67c50821-8012-4a48-8c3a-b0cc3d2ddcb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap43cc3477-22') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:39:44.706737 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lazy-loading 'pci_devices' on Instance uuid b53c3532-08c2-4c05-b5e5-c217d3ef4d9a {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:44.888582 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:44.908692 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:44.952352 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-cacb5753-5f6e-4255-94ac-1a167f32762e req-a43e9fcf-8e70-4dca-9c5e-785c8025c4c6 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Received event network-vif-unplugged-061a7108-6f47-4def-b12d-38eb13d382f6 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:44.952352 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-cacb5753-5f6e-4255-94ac-1a167f32762e req-a43e9fcf-8e70-4dca-9c5e-785c8025c4c6 service nova] Acquiring lock "c1043abd-b0c0-439e-b065-8bef627483cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:44.952352 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-cacb5753-5f6e-4255-94ac-1a167f32762e req-a43e9fcf-8e70-4dca-9c5e-785c8025c4c6 service nova] Lock "c1043abd-b0c0-439e-b065-8bef627483cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:44.952352 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-cacb5753-5f6e-4255-94ac-1a167f32762e req-a43e9fcf-8e70-4dca-9c5e-785c8025c4c6 service nova] Lock "c1043abd-b0c0-439e-b065-8bef627483cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:44.953781 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-cacb5753-5f6e-4255-94ac-1a167f32762e req-a43e9fcf-8e70-4dca-9c5e-785c8025c4c6 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] No waiting events found dispatching network-vif-unplugged-061a7108-6f47-4def-b12d-38eb13d382f6 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:39:44.954068 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-cacb5753-5f6e-4255-94ac-1a167f32762e req-a43e9fcf-8e70-4dca-9c5e-785c8025c4c6 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Received unexpected event network-vif-unplugged-061a7108-6f47-4def-b12d-38eb13d382f6 for instance with vm_state active and task_state resize_migrating. Jun 26 10:39:45.021120 np0000003731 nova-compute[98967]: DEBUG nova.utils [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Queued Task(fn=>, remaining_delay=14.99966530100005 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:39:45.023777 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Instance destroyed successfully. Jun 26 10:39:45.025315 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='multiattach-server-0',id=14,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIANZiDTtI5cmApVvRJAaLuw+rm1nR4eCOZjHwVoNWhAR53DFExlyLfMWz+jjXnkCXdfpUcLxD2eMk9e+d1HV7SCzQccChfvPKV4jw2Mlc92UdPlKs2IxpAJWXP9L/ysw==',key_name='tempest-keypair-1990365436',keypairs=,launch_index=0,launched_at=2026-06-26T10:38:42Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='49c2798faed447838b6c87f6d15cce66',ramdisk_id='',reservation_id='r-dloghlmq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1668992443',owner_user_name='tempest-AttachVolumeMultiAttachTest-1668992443-project-member'},tags=,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:39:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a8a0b0240a34fb0bcf62ee7ec259cb2',uuid=c1043abd-b0c0-439e-b065-8bef627483cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "061a7108-6f47-4def-b12d-38eb13d382f6", "address": "fa:16:3e:48:bc:a4", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "vif_mac": "fa:16:3e:48:bc:a4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap061a7108-6f", "ovs_interfaceid": "061a7108-6f47-4def-b12d-38eb13d382f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 26 10:39:45.025591 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Converting VIF {"id": "061a7108-6f47-4def-b12d-38eb13d382f6", "address": "fa:16:3e:48:bc:a4", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "vif_mac": "fa:16:3e:48:bc:a4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap061a7108-6f", "ovs_interfaceid": "061a7108-6f47-4def-b12d-38eb13d382f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:39:45.027098 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:48:bc:a4,bridge_name='br-int',has_traffic_filtering=True,id=061a7108-6f47-4def-b12d-38eb13d382f6,network=Network(204eb6a3-9452-412e-ab0b-1594eb86bed2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap061a7108-6f') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:39:45.027864 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:bc:a4,bridge_name='br-int',has_traffic_filtering=True,id=061a7108-6f47-4def-b12d-38eb13d382f6,network=Network(204eb6a3-9452-412e-ab0b-1594eb86bed2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap061a7108-6f') {{(pid=98967) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 26 10:39:45.030781 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:45.031148 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap061a7108-6f, bridge=br-int, if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:45.033744 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:45.033744 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:39:45.047635 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-5e3a1bbd-9f85-4275-8dd5-20ddf279ad30 req-66a6498c-f61d-464c-bf82-d5dfbf8cdbb3 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:45.053175 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:45.054917 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:45.055253 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ae44e6ef-1df1-4a30-8c09-433bd58cd46a) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:39:45.060354 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:45.061271 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:39:45.074354 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:45.077762 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:45.081823 np0000003731 nova-compute[98967]: INFO os_vif [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:48:bc:a4,bridge_name='br-int',has_traffic_filtering=True,id=061a7108-6f47-4def-b12d-38eb13d382f6,network=Network(204eb6a3-9452-412e-ab0b-1594eb86bed2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap061a7108-6f') Jun 26 10:39:45.209349 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] End _get_guest_xml xml= Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: instance-00000014 Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: 196608 Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: tempest-ServerBootFromVolumeStableRescueTest-server-1292545386 Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: 2026-06-26 10:39:38 Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: 192 Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: 0 Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: 0 Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: True Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: bare Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: 0 Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: ide Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: virtio Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: pc Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: virtio Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: virtio Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: virtio Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: tempest-ServerBootFromVolumeStableRescueTest-618712607 Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: hvm Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: 128 Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: dc71798f-22b5-44d3-8fac-77084df22f84 Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: Jun 26 10:39:45.210545 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:39:45.217879 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Instance destroyed successfully. Jun 26 10:39:45.254908 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Creating config drive at /opt/stack/data/nova/instances/619d915a-12c9-424f-8c12-b2a3f94a4109/disk.config Jun 26 10:39:45.260798 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/619d915a-12c9-424f-8c12-b2a3f94a4109/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpujg_rqgj {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:45.302167 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-5e3a1bbd-9f85-4275-8dd5-20ddf279ad30 req-66a6498c-f61d-464c-bf82-d5dfbf8cdbb3 service nova] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Updated VIF entry in instance network info cache for port 288e6be4-7ae8-4847-ad8e-a0b0b95afa6d. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:39:45.302615 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-5e3a1bbd-9f85-4275-8dd5-20ddf279ad30 req-66a6498c-f61d-464c-bf82-d5dfbf8cdbb3 service nova] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Updating instance_info_cache with network_info: [{"id": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "address": "fa:16:3e:41:2f:75", "network": {"id": "66d12b1b-32f2-4152-b44c-13e5284b49f9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-186021134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a4e84471c94128b1ac4dd00ca7177b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap288e6be4-7a", "ovs_interfaceid": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:39:45.321231 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/619d915a-12c9-424f-8c12-b2a3f94a4109/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpujg_rqgj" returned: 0 in 0.060s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:45.648144 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Detected multiple connections on this host for volume: 1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d, skipping target disconnect. Jun 26 10:39:45.652585 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:45.759533 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:45.760878 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:45.806399 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5e3a1bbd-9f85-4275-8dd5-20ddf279ad30 req-66a6498c-f61d-464c-bf82-d5dfbf8cdbb3 service nova] Releasing lock "refresh_cache-3dd6ac52-de12-47da-bc90-77d0fff44acf" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:39:45.829400 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:45.859891 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:45.860881 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] skipping disk /dev/dm-8 (vdb) as it is a volume {{(pid=98967) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 26 10:39:45.861733 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb_resize/disk /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:45.883630 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:45.954734 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-6e93deed-7dfb-48b1-aeff-388623461938 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 7.669s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:46.002127 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:46.038321 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "cp -r /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb_resize/disk /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk" returned: 0 in 0.176s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:46.040127 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb_resize/disk.config /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk.config {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:46.089687 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "cp -r /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb_resize/disk.config /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk.config" returned: 0 in 0.049s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:46.090910 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb_resize/disk.info /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk.info {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:46.143665 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "cp -r /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb_resize/disk.info /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk.info" returned: 0 in 0.052s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:46.327084 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:46.340664 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:46.346756 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:46.381886 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:46.388955 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Rescuing Jun 26 10:39:46.390819 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "refresh_cache-c8aff61a-5f59-4f8c-8288-abd5a7853474" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:39:46.390819 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquired lock "refresh_cache-c8aff61a-5f59-4f8c-8288-abd5a7853474" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:39:46.390819 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:39:46.394761 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:46.789430 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:39:46.789563 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:39:46.789641 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:39:46.789806 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] No VIF found with MAC fa:16:3e:0e:19:b0, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:39:46.790540 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Using config drive Jun 26 10:39:46.892886 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:47.048726 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-34595e35-21ff-429e-a027-1d4741b87473 req-908a702d-745b-403d-a9d6-f792f5aa92d6 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Received event network-vif-unplugged-061a7108-6f47-4def-b12d-38eb13d382f6 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:47.048726 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-34595e35-21ff-429e-a027-1d4741b87473 req-908a702d-745b-403d-a9d6-f792f5aa92d6 service nova] Acquiring lock "c1043abd-b0c0-439e-b065-8bef627483cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:47.048726 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-34595e35-21ff-429e-a027-1d4741b87473 req-908a702d-745b-403d-a9d6-f792f5aa92d6 service nova] Lock "c1043abd-b0c0-439e-b065-8bef627483cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:47.048726 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-34595e35-21ff-429e-a027-1d4741b87473 req-908a702d-745b-403d-a9d6-f792f5aa92d6 service nova] Lock "c1043abd-b0c0-439e-b065-8bef627483cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:47.048726 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-34595e35-21ff-429e-a027-1d4741b87473 req-908a702d-745b-403d-a9d6-f792f5aa92d6 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] No waiting events found dispatching network-vif-unplugged-061a7108-6f47-4def-b12d-38eb13d382f6 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:39:47.048726 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-34595e35-21ff-429e-a027-1d4741b87473 req-908a702d-745b-403d-a9d6-f792f5aa92d6 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Received unexpected event network-vif-unplugged-061a7108-6f47-4def-b12d-38eb13d382f6 for instance with vm_state active and task_state resize_migrating. Jun 26 10:39:47.048726 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-34595e35-21ff-429e-a027-1d4741b87473 req-908a702d-745b-403d-a9d6-f792f5aa92d6 service nova] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Received event network-vif-plugged-0825879a-7c75-4a22-b61e-d9289b60926b {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:47.048726 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-34595e35-21ff-429e-a027-1d4741b87473 req-908a702d-745b-403d-a9d6-f792f5aa92d6 service nova] Acquiring lock "619d915a-12c9-424f-8c12-b2a3f94a4109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:47.048726 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-34595e35-21ff-429e-a027-1d4741b87473 req-908a702d-745b-403d-a9d6-f792f5aa92d6 service nova] Lock "619d915a-12c9-424f-8c12-b2a3f94a4109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:47.048726 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-34595e35-21ff-429e-a027-1d4741b87473 req-908a702d-745b-403d-a9d6-f792f5aa92d6 service nova] Lock "619d915a-12c9-424f-8c12-b2a3f94a4109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:47.048726 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-34595e35-21ff-429e-a027-1d4741b87473 req-908a702d-745b-403d-a9d6-f792f5aa92d6 service nova] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Processing event network-vif-plugged-0825879a-7c75-4a22-b61e-d9289b60926b {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:39:47.048726 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-34595e35-21ff-429e-a027-1d4741b87473 req-908a702d-745b-403d-a9d6-f792f5aa92d6 service nova] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Received event network-vif-plugged-0825879a-7c75-4a22-b61e-d9289b60926b {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:47.048726 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-34595e35-21ff-429e-a027-1d4741b87473 req-908a702d-745b-403d-a9d6-f792f5aa92d6 service nova] Acquiring lock "619d915a-12c9-424f-8c12-b2a3f94a4109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:47.049360 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-34595e35-21ff-429e-a027-1d4741b87473 req-908a702d-745b-403d-a9d6-f792f5aa92d6 service nova] Lock "619d915a-12c9-424f-8c12-b2a3f94a4109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:47.049360 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-34595e35-21ff-429e-a027-1d4741b87473 req-908a702d-745b-403d-a9d6-f792f5aa92d6 service nova] Lock "619d915a-12c9-424f-8c12-b2a3f94a4109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:47.049487 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-34595e35-21ff-429e-a027-1d4741b87473 req-908a702d-745b-403d-a9d6-f792f5aa92d6 service nova] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] No waiting events found dispatching network-vif-plugged-0825879a-7c75-4a22-b61e-d9289b60926b {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:39:47.049621 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-34595e35-21ff-429e-a027-1d4741b87473 req-908a702d-745b-403d-a9d6-f792f5aa92d6 service nova] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Received unexpected event network-vif-plugged-0825879a-7c75-4a22-b61e-d9289b60926b for instance with vm_state building and task_state spawning. Jun 26 10:39:47.119630 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:39:47.120669 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:39:47.121249 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] VM Started (Lifecycle Event) Jun 26 10:39:47.129106 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Guest created on hypervisor {{(pid=98967) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 26 10:39:47.134246 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Instance spawned successfully. Jun 26 10:39:47.134764 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 26 10:39:47.293674 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lazy-loading 'ec2_ids' on Instance uuid b53c3532-08c2-4c05-b5e5-c217d3ef4d9a {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:47.417490 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:47.417876 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:47.425833 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:47.524622 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:47.536241 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Port 061a7108-6f47-4def-b12d-38eb13d382f6 binding to destination host np0000003731 is already ACTIVE {{(pid=98967) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}} Jun 26 10:39:47.624225 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:47.626197 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:39:47.643219 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Found default for hw_cdrom_bus of ide {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:47.643396 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Found default for hw_disk_bus of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:47.643974 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Found default for hw_input_bus of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:47.644704 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Found default for hw_pointer_model of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:47.645263 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Found default for hw_video_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:47.645636 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Found default for hw_vif_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:39:47.651973 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Updating instance_info_cache with network_info: [{"id": "93123956-587e-4fec-b4de-833327660f6e", "address": "fa:16:3e:78:44:6c", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93123956-58", "ovs_interfaceid": "93123956-587e-4fec-b4de-833327660f6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:39:47.799439 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:39:47.799584 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lazy-loading 'keypairs' on Instance uuid b53c3532-08c2-4c05-b5e5-c217d3ef4d9a {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:48.129465 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] During sync_power_state the instance has a pending task (spawning). Skip. Jun 26 10:39:48.129952 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Paused> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:39:48.130302 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] VM Paused (Lifecycle Event) Jun 26 10:39:48.155781 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Took 8.33 seconds to spawn the instance on the hypervisor. Jun 26 10:39:48.156582 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Releasing lock "refresh_cache-c8aff61a-5f59-4f8c-8288-abd5a7853474" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:39:48.158229 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:48.302191 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:39:48.305285 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:48.443340 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Creating config drive at /opt/stack/data/nova/instances/b53c3532-08c2-4c05-b5e5-c217d3ef4d9a/disk.config.rescue Jun 26 10:39:48.446872 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/b53c3532-08c2-4c05-b5e5-c217d3ef4d9a/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpa1hu7hrm {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:48.503910 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/b53c3532-08c2-4c05-b5e5-c217d3ef4d9a/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpa1hu7hrm" returned: 0 in 0.057s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:48.550045 np0000003731 nova-compute[98967]: DEBUG nova.compute.rpcapi [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98967) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 26 10:39:48.566796 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "c1043abd-b0c0-439e-b065-8bef627483cb-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:48.567344 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "c1043abd-b0c0-439e-b065-8bef627483cb-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:48.567646 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "c1043abd-b0c0-439e-b065-8bef627483cb-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:48.635150 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:48.638945 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:39:48.639169 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] VM Resumed (Lifecycle Event) Jun 26 10:39:48.671469 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Took 14.39 seconds to build instance. Jun 26 10:39:49.041643 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:49.080051 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:49.083992 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:49.145864 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:49.154134 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:39:49.174401 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-35f101b1-4fdb-4140-bb46-e85d45ecf63a tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lock "619d915a-12c9-424f-8c12-b2a3f94a4109" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.909s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:49.189956 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:49.276335 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:49.363629 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b0fe5ba9-accb-43a7-9e92-0722de57bf1b req-4a300305-11a0-41c6-a2ac-da10839d2f80 service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Received event network-vif-plugged-43cc3477-2288-4c03-8374-5701e3d3baa1 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:49.363629 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b0fe5ba9-accb-43a7-9e92-0722de57bf1b req-4a300305-11a0-41c6-a2ac-da10839d2f80 service nova] Acquiring lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:49.363629 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b0fe5ba9-accb-43a7-9e92-0722de57bf1b req-4a300305-11a0-41c6-a2ac-da10839d2f80 service nova] Lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:49.363629 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b0fe5ba9-accb-43a7-9e92-0722de57bf1b req-4a300305-11a0-41c6-a2ac-da10839d2f80 service nova] Lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:49.363629 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b0fe5ba9-accb-43a7-9e92-0722de57bf1b req-4a300305-11a0-41c6-a2ac-da10839d2f80 service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] No waiting events found dispatching network-vif-plugged-43cc3477-2288-4c03-8374-5701e3d3baa1 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:39:49.364056 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-b0fe5ba9-accb-43a7-9e92-0722de57bf1b req-4a300305-11a0-41c6-a2ac-da10839d2f80 service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Received unexpected event network-vif-plugged-43cc3477-2288-4c03-8374-5701e3d3baa1 for instance with vm_state active and task_state rescuing. Jun 26 10:39:49.575748 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:49.702707 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "refresh_cache-c1043abd-b0c0-439e-b065-8bef627483cb" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:39:49.702888 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquired lock "refresh_cache-c1043abd-b0c0-439e-b065-8bef627483cb" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:39:49.703468 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:39:49.818786 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:49.826210 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:49.846954 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:50.023370 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-dce72427-d878-48b1-bb8c-7d12378b4c84 req-530258cd-dc60-4819-8a40-568160d26917 service nova] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Received event network-changed-0825879a-7c75-4a22-b61e-d9289b60926b {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:50.023584 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-dce72427-d878-48b1-bb8c-7d12378b4c84 req-530258cd-dc60-4819-8a40-568160d26917 service nova] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Refreshing instance network info cache due to event network-changed-0825879a-7c75-4a22-b61e-d9289b60926b. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:39:50.023701 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-dce72427-d878-48b1-bb8c-7d12378b4c84 req-530258cd-dc60-4819-8a40-568160d26917 service nova] Acquiring lock "refresh_cache-619d915a-12c9-424f-8c12-b2a3f94a4109" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:39:50.023792 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-dce72427-d878-48b1-bb8c-7d12378b4c84 req-530258cd-dc60-4819-8a40-568160d26917 service nova] Acquired lock "refresh_cache-619d915a-12c9-424f-8c12-b2a3f94a4109" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:39:50.023891 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-dce72427-d878-48b1-bb8c-7d12378b4c84 req-530258cd-dc60-4819-8a40-568160d26917 service nova] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Refreshing network info cache for port 0825879a-7c75-4a22-b61e-d9289b60926b {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:39:50.035606 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:50.036936 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-cb14e7f9-d23b-4976-b8a6-5468dcf746f8 req-8b8cb5a7-6aea-4607-bb12-fcf2f7596b25 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Received event network-vif-unplugged-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:50.037709 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-cb14e7f9-d23b-4976-b8a6-5468dcf746f8 req-8b8cb5a7-6aea-4607-bb12-fcf2f7596b25 service nova] Acquiring lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:50.038154 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-cb14e7f9-d23b-4976-b8a6-5468dcf746f8 req-8b8cb5a7-6aea-4607-bb12-fcf2f7596b25 service nova] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:50.038338 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-cb14e7f9-d23b-4976-b8a6-5468dcf746f8 req-8b8cb5a7-6aea-4607-bb12-fcf2f7596b25 service nova] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:50.038517 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-cb14e7f9-d23b-4976-b8a6-5468dcf746f8 req-8b8cb5a7-6aea-4607-bb12-fcf2f7596b25 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] No waiting events found dispatching network-vif-unplugged-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:39:50.038954 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-cb14e7f9-d23b-4976-b8a6-5468dcf746f8 req-8b8cb5a7-6aea-4607-bb12-fcf2f7596b25 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Received unexpected event network-vif-unplugged-93123956-587e-4fec-b4de-833327660f6e for instance with vm_state active and task_state rescuing. Jun 26 10:39:50.046543 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:50.056272 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:50.150421 np0000003731 nova-compute[98967]: DEBUG nova.utils [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Queued Task(fn=>, remaining_delay=14.99961283399989 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:39:50.157287 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Instance destroyed successfully. Jun 26 10:39:50.158109 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'numa_topology' on Instance uuid c8aff61a-5f59-4f8c-8288-abd5a7853474 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:50.207720 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:50.284725 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Removed pending STOPPED event for b53c3532-08c2-4c05-b5e5-c217d3ef4d9a due to new event Resumed> {{(pid=98967) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 26 10:39:50.286251 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:39:50.286251 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] VM Resumed (Lifecycle Event) Jun 26 10:39:50.291561 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-85a7f501-7cbc-4df4-b903-2a906b1b6a5c tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:50.528531 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-dce72427-d878-48b1-bb8c-7d12378b4c84 req-530258cd-dc60-4819-8a40-568160d26917 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:50.635202 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:50.665174 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Attempting rescue Jun 26 10:39:50.666051 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] rescue generated disk_info: {'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} {{(pid=98967) rescue /opt/stack/nova/nova/virt/libvirt/driver.py:4640}} Jun 26 10:39:50.675275 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Instance directory exists: not creating {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}} Jun 26 10:39:50.675544 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Creating image(s) Jun 26 10:39:50.676294 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "/opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:50.676471 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "/opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:50.676985 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "/opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:50.680506 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'trusted_certs' on Instance uuid c8aff61a-5f59-4f8c-8288-abd5a7853474 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:50.792359 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:50.798337 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:39:50.884441 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Updating instance_info_cache with network_info: [{"id": "061a7108-6f47-4def-b12d-38eb13d382f6", "address": "fa:16:3e:48:bc:a4", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap061a7108-6f", "ovs_interfaceid": "061a7108-6f47-4def-b12d-38eb13d382f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:39:51.052777 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-dce72427-d878-48b1-bb8c-7d12378b4c84 req-530258cd-dc60-4819-8a40-568160d26917 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:51.185857 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:39:51.186689 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:39:51.191485 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:39:51.192516 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:51.193036 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:51.193514 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:39:51.198847 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:39:51.199459 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:51.268552 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-dce72427-d878-48b1-bb8c-7d12378b4c84 req-530258cd-dc60-4819-8a40-568160d26917 service nova] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Updated VIF entry in instance network info cache for port 0825879a-7c75-4a22-b61e-d9289b60926b. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:39:51.269296 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-dce72427-d878-48b1-bb8c-7d12378b4c84 req-530258cd-dc60-4819-8a40-568160d26917 service nova] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Updating instance_info_cache with network_info: [{"id": "0825879a-7c75-4a22-b61e-d9289b60926b", "address": "fa:16:3e:a4:49:e7", "network": {"id": "9d61e079-8b68-4387-9c86-1e9172058c20", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-936629968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d10b4c2e162455786d5aa40d72a31c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0825879a-7c", "ovs_interfaceid": "0825879a-7c75-4a22-b61e-d9289b60926b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:39:51.313107 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:39:51.313107 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] VM Started (Lifecycle Event) Jun 26 10:39:51.317260 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.118s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:51.317717 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474/disk.rescue {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:51.380474 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474/disk.rescue" returned: 0 in 0.062s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:51.381321 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.188s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:51.381560 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'migration_context' on Instance uuid c8aff61a-5f59-4f8c-8288-abd5a7853474 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:51.391903 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Releasing lock "refresh_cache-c1043abd-b0c0-439e-b065-8bef627483cb" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:39:51.402772 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-5a40e183-e06d-4893-956e-cb7325aae50f tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Unrescuing Jun 26 10:39:51.403019 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-5a40e183-e06d-4893-956e-cb7325aae50f tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "refresh_cache-b53c3532-08c2-4c05-b5e5-c217d3ef4d9a" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:39:51.403276 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-5a40e183-e06d-4893-956e-cb7325aae50f tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquired lock "refresh_cache-b53c3532-08c2-4c05-b5e5-c217d3ef4d9a" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:39:51.403478 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-5a40e183-e06d-4893-956e-cb7325aae50f tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:39:51.458083 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-1b26be6c-4831-4fac-93ad-bc3f28dd3e5a req-8de8409c-1f74-4337-b0e4-d1d132c7d961 service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Received event network-vif-plugged-43cc3477-2288-4c03-8374-5701e3d3baa1 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:51.458930 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-1b26be6c-4831-4fac-93ad-bc3f28dd3e5a req-8de8409c-1f74-4337-b0e4-d1d132c7d961 service nova] Acquiring lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:51.462658 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-1b26be6c-4831-4fac-93ad-bc3f28dd3e5a req-8de8409c-1f74-4337-b0e4-d1d132c7d961 service nova] Lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.004s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:51.462898 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-1b26be6c-4831-4fac-93ad-bc3f28dd3e5a req-8de8409c-1f74-4337-b0e4-d1d132c7d961 service nova] Lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:51.463192 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-1b26be6c-4831-4fac-93ad-bc3f28dd3e5a req-8de8409c-1f74-4337-b0e4-d1d132c7d961 service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] No waiting events found dispatching network-vif-plugged-43cc3477-2288-4c03-8374-5701e3d3baa1 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:39:51.463415 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-1b26be6c-4831-4fac-93ad-bc3f28dd3e5a req-8de8409c-1f74-4337-b0e4-d1d132c7d961 service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Received unexpected event network-vif-plugged-43cc3477-2288-4c03-8374-5701e3d3baa1 for instance with vm_state rescued and task_state unrescuing. Jun 26 10:39:51.642447 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0004442440001639625 future=) was cancelled during its delay period, skipping {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:39:51.642596 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:39:51.642652 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=8.377604980000115 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:39:51.642721 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=8.37752675500019 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:39:51.773130 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-dce72427-d878-48b1-bb8c-7d12378b4c84 req-530258cd-dc60-4819-8a40-568160d26917 service nova] Releasing lock "refresh_cache-619d915a-12c9-424f-8c12-b2a3f94a4109" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:39:51.814747 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:51.818268 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:39:51.884914 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:39:51.885419 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Created local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 26 10:39:51.886061 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Start _get_guest_xml network_info=[{"id": "93123956-587e-4fec-b4de-833327660f6e", "address": "fa:16:3e:78:44:6c", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "vif_mac": "fa:16:3e:78:44:6c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93123956-58", "ovs_interfaceid": "93123956-587e-4fec-b4de-833327660f6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'disk.rescue': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config.rescue': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=) rescue={'image_id': 'a9b18127-6fee-4ed6-b364-a2d634ecb8b7', 'kernel_id': '', 'ramdisk_id': ''} block_device_info=Noneshare_info=ShareMappingList(objects=[]) {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:39:51.886253 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'resources' on Instance uuid c8aff61a-5f59-4f8c-8288-abd5a7853474 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:51.911633 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-5a40e183-e06d-4893-956e-cb7325aae50f tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:51.915651 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.79', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003731', 'execute': None}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:39:51.927386 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.scaleio [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98967) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 10:39:51.954052 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): nvme version {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:51.994479 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] 'nvme version' failed. Not Retrying. {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 10:39:51.994479 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.nvmeof [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] nvme not present on system {{(pid=98967) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 10:39:52.005242 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98967) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 10:39:52.007731 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.lightos [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Current host hostNQN and IP(s) are ['10.4.3.79', 'fe80::f816:3eff:fe55:ba34', '192.168.40.6', 'fe80::f816:3eff:fe6b:fe1a', '192.168.50.6', 'fe80::f816:3eff:feca:9cd0', '192.168.10.6', 'fe80::f816:3eff:feb4:4e78', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f8bb:38ff:fe28:ff4a', 'fe80::fc16:3eff:fe37:b3f6', 'fe80::41a:feff:fe02:479d', 'fe80::fc16:3eff:fe5e:459', 'fe80::fc16:3eff:fe90:be9c', 'fe80::84cb:23ff:fe8e:e6e6', 'fe80::fc16:3eff:fe5a:811a', 'fe80::fc16:3eff:fe1b:5509', 'fe80::fc16:3eff:fef2:781c', 'fe80::b448:c6ff:fe9c:a1e9', 'fe80::fc16:3eff:fe43:d828', 'fe80::fc16:3eff:fe9c:6906', 'fe80::bc5e:80ff:fe69:218d', 'fe80::fc16:3eff:fefd:1020', 'fe80::fc16:3eff:fe17:f5ed', 'fe80::e4d7:e7ff:fe80:d900', 'fe80::fc16:3eff:feec:35bf', 'fe80::fc16:3eff:fe52:9c9b', 'fe80::fc16:3eff:feac:bc0b', 'fe80::fc16:3eff:feb3:64e7', 'fe80::fc16:3eff:fe6a:a465', 'fe80::6cd3:9eff:fe53:c46c', 'fe80::bc4e:7ff:fef8:a00a', 'fe80::fc16:3eff:fe97:321f', 'fe80::1cb1:31ff:fe57:6a2', 'fe80::fc16:3eff:fe41:2f75', 'fe80::d41a:ddff:fe9f:a411', 'fe80::fc16:3eff:fea4:49e7', 'fe80::acbf:48ff:fe2a:f93b', 'fe80::fc16:3eff:fe0e:19b0'] Jun 26 10:39:52.008156 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 10:39:52.008559 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] LIGHTOS: no hostnqn found. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 10:39:52.008642 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] <== get_connector_properties: return (92ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.79', 'host': 'np0000003731', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:2fddcc2116d6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '7f2a0776-2f14-4357-a22e-baa6677eb22e', 'nvme_native_multipath': False} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:39:52.145038 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-8c698d53-fe2c-43d6-b27c-4cdfba294041 req-09ff7d98-6854-4912-a6e7-b9964afec169 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Received event network-vif-unplugged-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:52.145038 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-8c698d53-fe2c-43d6-b27c-4cdfba294041 req-09ff7d98-6854-4912-a6e7-b9964afec169 service nova] Acquiring lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:52.145038 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-8c698d53-fe2c-43d6-b27c-4cdfba294041 req-09ff7d98-6854-4912-a6e7-b9964afec169 service nova] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:52.145038 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-8c698d53-fe2c-43d6-b27c-4cdfba294041 req-09ff7d98-6854-4912-a6e7-b9964afec169 service nova] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:52.145038 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-8c698d53-fe2c-43d6-b27c-4cdfba294041 req-09ff7d98-6854-4912-a6e7-b9964afec169 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] No waiting events found dispatching network-vif-unplugged-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:39:52.145038 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-8c698d53-fe2c-43d6-b27c-4cdfba294041 req-09ff7d98-6854-4912-a6e7-b9964afec169 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Received unexpected event network-vif-unplugged-93123956-587e-4fec-b4de-833327660f6e for instance with vm_state active and task_state rescuing. Jun 26 10:39:52.317081 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-5a40e183-e06d-4893-956e-cb7325aae50f tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:52.321442 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] During sync_power_state the instance has a pending task (unrescuing). Skip. Jun 26 10:39:52.388384 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:39:52.392365 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:39:52.393897 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='tempest-ServerRescueNegativeTestJSON-server-478371896', uuid='c8aff61a-5f59-4f8c-8288-abd5a7853474'), owner=OwnerMeta(userid='04176251e13046eb8cfc1908246d4d9d', username='tempest-ServerRescueNegativeTestJSON-1439990304-project-member', projectid='58a58b94e5ec406182da9117e14aa789', projectname='tempest-ServerRescueNegativeTestJSON-1439990304'), image=ImageMeta(id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "93123956-587e-4fec-b4de-833327660f6e", "address": "fa:16:3e:78:44:6c", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "vif_mac": "fa:16:3e:78:44:6c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93123956-58", "ovs_interfaceid": "93123956-587e-4fec-b4de-833327660f6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470392.3934455) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:39:52.395765 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:39:52.396262 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:39:52.398512 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:39:52.398796 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:39:52.399892 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:39:52.400574 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:39:52.400574 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:39:52.400574 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:39:52.400753 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:39:52.400795 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:39:52.400894 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:39:52.401490 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:39:52.401633 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:39:52.401764 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:39:52.401873 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:39:52.401985 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:39:52.402199 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'vcpu_model' on Instance uuid c8aff61a-5f59-4f8c-8288-abd5a7853474 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:52.492451 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-5a40e183-e06d-4893-956e-cb7325aae50f tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Updating instance_info_cache with network_info: [{"id": "43cc3477-2288-4c03-8374-5701e3d3baa1", "address": "fa:16:3e:0e:19:b0", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.9", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap43cc3477-22", "ovs_interfaceid": "43cc3477-2288-4c03-8374-5701e3d3baa1", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:39:52.527400 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:52.905849 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:39:52.921708 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-478371896',display_name='tempest-ServerRescueNegativeTestJSON-server-478371896',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-serverrescuenegativetestjson-server-478371896',id=17,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+OGQ8Eo1x4iFVwcFj09jg9sQh3dFHv74SAS4ZWyaekKEeCWVFry7SNIL4HTxAbAqZ7ppe/G6qaUIGoSh5uKAL1TZC+RDK6nNG7j6kwengqZDEKTSAcP05cc2XBMrVz9A==',key_name='tempest-keypair-1478353236',keypairs=,launch_index=0,launched_at=2026-06-26T10:38:57Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='58a58b94e5ec406182da9117e14aa789',ramdisk_id='',reservation_id='r-vvq7102i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1439990304',owner_user_name='tempest-ServerRescueNegativeTestJSON-1439990304-project-member'},tags=,task_state='rescuing',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:38:57Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04176251e13046eb8cfc1908246d4d9d',uuid=c8aff61a-5f59-4f8c-8288-abd5a7853474,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93123956-587e-4fec-b4de-833327660f6e", "address": "fa:16:3e:78:44:6c", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "vif_mac": "fa:16:3e:78:44:6c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93123956-58", "ovs_interfaceid": "93123956-587e-4fec-b4de-833327660f6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:39:52.921922 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Converting VIF {"id": "93123956-587e-4fec-b4de-833327660f6e", "address": "fa:16:3e:78:44:6c", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.116", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "vif_mac": "fa:16:3e:78:44:6c"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93123956-58", "ovs_interfaceid": "93123956-587e-4fec-b4de-833327660f6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:39:52.922724 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:44:6c,bridge_name='br-int',has_traffic_filtering=True,id=93123956-587e-4fec-b4de-833327660f6e,network=Network(d50baa85-72ef-4bb3-9676-e629d583d3a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93123956-58') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:39:52.923464 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'pci_devices' on Instance uuid c8aff61a-5f59-4f8c-8288-abd5a7853474 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:52.996180 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-5a40e183-e06d-4893-956e-cb7325aae50f tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Releasing lock "refresh_cache-b53c3532-08c2-4c05-b5e5-c217d3ef4d9a" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:39:52.996807 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-5a40e183-e06d-4893-956e-cb7325aae50f tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lazy-loading 'flavor' on Instance uuid b53c3532-08c2-4c05-b5e5-c217d3ef4d9a {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:53.199765 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Starting finish_migration {{(pid=98967) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12808}} Jun 26 10:39:53.201355 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Instance directory exists: not creating {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}} Jun 26 10:39:53.201515 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Creating image(s) Jun 26 10:39:53.202407 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:53.294398 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.092s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:53.294873 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Checking if we can resize image /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk. size=1073741824 {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 26 10:39:53.295353 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:53.401803 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:53.402359 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Cannot resize image /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk to a smaller size. {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 26 10:39:53.426269 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] End _get_guest_xml xml= Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: c8aff61a-5f59-4f8c-8288-abd5a7853474 Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: instance-00000011 Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: 196608 Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: tempest-ServerRescueNegativeTestJSON-server-478371896 Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: 2026-06-26 10:39:52 Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: 192 Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: 0 Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: 0 Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: True Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: bare Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: 0 Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: ide Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: virtio Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: pc Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: virtio Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: virtio Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: virtio Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: tempest-ServerRescueNegativeTestJSON-1439990304-project-member Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: tempest-ServerRescueNegativeTestJSON-1439990304 Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: c8aff61a-5f59-4f8c-8288-abd5a7853474 Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: c8aff61a-5f59-4f8c-8288-abd5a7853474 Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: hvm Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: 128 Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: 1 Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: Jun 26 10:39:53.428114 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:39:53.436262 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Instance destroyed successfully. Jun 26 10:39:53.543679 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:53.552430 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:53.590900 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:53.743860 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:53.756468 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:53.841759 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-a42f697b-1dc6-43b1-af4e-027aa2826f8d req-8b8e6b3d-1b5f-4579-9128-f4ac2964e42b service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Received event network-vif-unplugged-43cc3477-2288-4c03-8374-5701e3d3baa1 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:53.842242 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-a42f697b-1dc6-43b1-af4e-027aa2826f8d req-8b8e6b3d-1b5f-4579-9128-f4ac2964e42b service nova] Acquiring lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:53.842806 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-a42f697b-1dc6-43b1-af4e-027aa2826f8d req-8b8e6b3d-1b5f-4579-9128-f4ac2964e42b service nova] Lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:53.842806 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-a42f697b-1dc6-43b1-af4e-027aa2826f8d req-8b8e6b3d-1b5f-4579-9128-f4ac2964e42b service nova] Lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:53.842806 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-a42f697b-1dc6-43b1-af4e-027aa2826f8d req-8b8e6b3d-1b5f-4579-9128-f4ac2964e42b service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] No waiting events found dispatching network-vif-unplugged-43cc3477-2288-4c03-8374-5701e3d3baa1 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:39:53.845282 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-a42f697b-1dc6-43b1-af4e-027aa2826f8d req-8b8e6b3d-1b5f-4579-9128-f4ac2964e42b service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Received unexpected event network-vif-unplugged-43cc3477-2288-4c03-8374-5701e3d3baa1 for instance with vm_state rescued and task_state unrescuing. Jun 26 10:39:53.877329 np0000003731 nova-compute[98967]: DEBUG nova.utils [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Queued Task(fn=>, remaining_delay=14.999586363999924 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:39:53.879377 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Instance destroyed successfully. Jun 26 10:39:53.880024 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-5a40e183-e06d-4893-956e-cb7325aae50f tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lazy-loading 'numa_topology' on Instance uuid b53c3532-08c2-4c05-b5e5-c217d3ef4d9a {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:53.906073 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Did not create local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 26 10:39:53.906371 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Ensure instance console log exists: /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/console.log {{(pid=98967) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 26 10:39:53.910172 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:53.910172 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:53.910172 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:53.916229 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Start _get_guest_xml network_info=[{"id": "061a7108-6f47-4def-b12d-38eb13d382f6", "address": "fa:16:3e:48:bc:a4", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "vif_mac": "fa:16:3e:48:bc:a4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap061a7108-6f", "ovs_interfaceid": "061a7108-6f47-4def-b12d-38eb13d382f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'image_id': 'a9b18127-6fee-4ed6-b364-a2d634ecb8b7'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': 'c1043abd-b0c0-439e-b065-8bef627483cb', 'attached_at': '2026-06-26T10:39:52.000000', 'detached_at': '', 'volume_id': '1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'multiattach': True, 'serial': '1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d'}, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': '89e3bb93-e1d8-4cbe-b05f-3a5358611a10', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:39:53.924342 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:39:53.926039 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='multiattach-server-0', uuid='c1043abd-b0c0-439e-b065-8bef627483cb'), owner=OwnerMeta(userid='8a8a0b0240a34fb0bcf62ee7ec259cb2', username='tempest-AttachVolumeMultiAttachTest-1668992443-project-member', projectid='49c2798faed447838b6c87f6d15cce66', projectname='tempest-AttachVolumeMultiAttachTest-1668992443'), image=ImageMeta(id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "061a7108-6f47-4def-b12d-38eb13d382f6", "address": "fa:16:3e:48:bc:a4", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "vif_mac": "fa:16:3e:48:bc:a4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap061a7108-6f", "ovs_interfaceid": "061a7108-6f47-4def-b12d-38eb13d382f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470393.9255455) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:39:53.927123 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:39:53.927557 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:39:53.928924 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:39:53.929248 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:39:53.930121 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:39:53.930449 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:39:53.930613 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:39:53.930733 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:39:53.930879 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:39:53.931029 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:39:53.931211 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:39:53.931407 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:39:53.931563 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:39:53.931725 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:39:53.931884 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:39:53.932168 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:39:53.945923 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk.config --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:54.061916 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk.config --force-share --output=json" returned: 0 in 0.116s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:54.062522 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "/opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:54.062821 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "/opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:54.064328 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "/opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:54.064820 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Calling os-brick to attach iSCSI Volume {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 26 10:39:54.065378 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:39:54.065618 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:54.066148 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:54.066470 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 10:39:54.079772 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:54.080687 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:39:54.081211 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:54.081429 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:39:54.082002 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:39:54.082355 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.startup = automatic Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.session.scan = manual Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.40.100 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:39:54.096821 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.startup = automatic Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.session.scan = manual Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.50.100 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:39:54.108122 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:54.118037 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:54.124149 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:39:54.139039 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:54.139039 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:54.139039 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:54.139039 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:54.139039 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:54.139039 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:54.139039 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:54.139039 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:54.139039 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:54.139039 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:54.139039 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:54.139039 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:54.139039 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:54.139039 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:54.139039 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:39:54.139039 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:39:54.139039 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:54.139525 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:54.139525 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:54.139525 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:54.139525 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:54.139525 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:54.139525 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:54.139525 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:54.139525 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:54.139525 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:54.139525 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:54.139525 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:54.139525 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:54.139525 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:54.139525 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:54.139525 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:39:54.139525 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:39:54.139525 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:54.139881 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.059s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:39:54.139881 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Connected to 192.168.40.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:39:54.143033 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] HCTL ('16', '0', '0', 0) found on session 29 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:39:54.143033 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Scanning host 16 c: 0, t: 0, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:39:54.149938 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:54.149938 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:54.149938 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:54.149938 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:54.149938 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:54.149938 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:54.149938 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:54.149938 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:54.149938 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:54.149938 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:54.149938 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:54.149938 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:54.149938 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:54.149938 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:54.149938 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:39:54.149938 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:39:54.149938 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:39:54.150386 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:54.150386 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:54.150386 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:39:54.150386 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:54.150386 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:39:54.150386 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:54.150386 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:39:54.150386 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:54.150386 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:39:54.150386 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:39:54.150386 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:54.150386 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:39:54.150386 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:54.150386 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:39:54.150386 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:39:54.150386 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:39:54.150386 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:39:54.150675 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 0.069s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:39:54.150675 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Connected to 192.168.50.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:39:54.151642 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] HCTL ('15', '0', '0', 0) found on session 28 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:39:54.151891 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Scanning host 15 c: 0, t: 0, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:39:54.152549 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Searching for a device in session 29 and hctl ('16', '0', '0', 0) yield: sdk {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:39:54.152801 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Connected to sdk using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:39:54.160729 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Searching for a device in session 28 and hctl ('15', '0', '0', 0) yield: sdj {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:39:54.160938 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Connected to sdj using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:39:54.382407 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-5a40e183-e06d-4893-956e-cb7325aae50f tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Object Instance lazy-loaded attributes: flavor,numa_topology {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:39:54.886953 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:54.942719 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:54.977261 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:39:54.977261 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:39:54.977487 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:39:54.977487 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] No VIF found with MAC fa:16:3e:78:44:6c, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:39:54.978176 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Using config drive Jun 26 10:39:55.048227 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:55.057763 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:55.059348 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:55.069576 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:55.081886 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 26 10:39:55.483888 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'ec2_ids' on Instance uuid c8aff61a-5f59-4f8c-8288-abd5a7853474 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:55.933265 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-dd2b9c4a-4b05-454b-8a6f-78067a4efc47 req-262a5bfc-b185-41d6-8a85-2659c001d235 service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Received event network-vif-unplugged-43cc3477-2288-4c03-8374-5701e3d3baa1 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:55.933793 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-dd2b9c4a-4b05-454b-8a6f-78067a4efc47 req-262a5bfc-b185-41d6-8a85-2659c001d235 service nova] Acquiring lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:55.933793 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-dd2b9c4a-4b05-454b-8a6f-78067a4efc47 req-262a5bfc-b185-41d6-8a85-2659c001d235 service nova] Lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:55.933793 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-dd2b9c4a-4b05-454b-8a6f-78067a4efc47 req-262a5bfc-b185-41d6-8a85-2659c001d235 service nova] Lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:55.934033 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-dd2b9c4a-4b05-454b-8a6f-78067a4efc47 req-262a5bfc-b185-41d6-8a85-2659c001d235 service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] No waiting events found dispatching network-vif-unplugged-43cc3477-2288-4c03-8374-5701e3d3baa1 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:39:55.934082 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-dd2b9c4a-4b05-454b-8a6f-78067a4efc47 req-262a5bfc-b185-41d6-8a85-2659c001d235 service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Received unexpected event network-vif-unplugged-43cc3477-2288-4c03-8374-5701e3d3baa1 for instance with vm_state rescued and task_state unrescuing. Jun 26 10:39:55.934234 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-dd2b9c4a-4b05-454b-8a6f-78067a4efc47 req-262a5bfc-b185-41d6-8a85-2659c001d235 service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Received event network-vif-plugged-43cc3477-2288-4c03-8374-5701e3d3baa1 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:55.934387 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-dd2b9c4a-4b05-454b-8a6f-78067a4efc47 req-262a5bfc-b185-41d6-8a85-2659c001d235 service nova] Acquiring lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:55.935202 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-dd2b9c4a-4b05-454b-8a6f-78067a4efc47 req-262a5bfc-b185-41d6-8a85-2659c001d235 service nova] Lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:55.935342 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-dd2b9c4a-4b05-454b-8a6f-78067a4efc47 req-262a5bfc-b185-41d6-8a85-2659c001d235 service nova] Lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:55.935468 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-dd2b9c4a-4b05-454b-8a6f-78067a4efc47 req-262a5bfc-b185-41d6-8a85-2659c001d235 service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] No waiting events found dispatching network-vif-plugged-43cc3477-2288-4c03-8374-5701e3d3baa1 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:39:55.935543 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-dd2b9c4a-4b05-454b-8a6f-78067a4efc47 req-262a5bfc-b185-41d6-8a85-2659c001d235 service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Received unexpected event network-vif-plugged-43cc3477-2288-4c03-8374-5701e3d3baa1 for instance with vm_state rescued and task_state unrescuing. Jun 26 10:39:55.935641 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-dd2b9c4a-4b05-454b-8a6f-78067a4efc47 req-262a5bfc-b185-41d6-8a85-2659c001d235 service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Received event network-vif-plugged-43cc3477-2288-4c03-8374-5701e3d3baa1 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:55.935755 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-dd2b9c4a-4b05-454b-8a6f-78067a4efc47 req-262a5bfc-b185-41d6-8a85-2659c001d235 service nova] Acquiring lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:55.935880 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-dd2b9c4a-4b05-454b-8a6f-78067a4efc47 req-262a5bfc-b185-41d6-8a85-2659c001d235 service nova] Lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:55.936027 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-dd2b9c4a-4b05-454b-8a6f-78067a4efc47 req-262a5bfc-b185-41d6-8a85-2659c001d235 service nova] Lock "b53c3532-08c2-4c05-b5e5-c217d3ef4d9a-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:55.936156 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-dd2b9c4a-4b05-454b-8a6f-78067a4efc47 req-262a5bfc-b185-41d6-8a85-2659c001d235 service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] No waiting events found dispatching network-vif-plugged-43cc3477-2288-4c03-8374-5701e3d3baa1 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:39:55.936278 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-dd2b9c4a-4b05-454b-8a6f-78067a4efc47 req-262a5bfc-b185-41d6-8a85-2659c001d235 service nova] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Received unexpected event network-vif-plugged-43cc3477-2288-4c03-8374-5701e3d3baa1 for instance with vm_state rescued and task_state unrescuing. Jun 26 10:39:55.987397 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:39:55.987693 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'keypairs' on Instance uuid c8aff61a-5f59-4f8c-8288-abd5a7853474 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:56.118037 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Removed pending STOPPED event for b53c3532-08c2-4c05-b5e5-c217d3ef4d9a due to new event Resumed> {{(pid=98967) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 26 10:39:56.118037 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:39:56.118037 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] VM Resumed (Lifecycle Event) Jun 26 10:39:56.118271 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-5a40e183-e06d-4893-956e-cb7325aae50f tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:56.490579 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Object Instance lazy-loaded attributes: numa_topology,trusted_certs,migration_context,resources,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:39:56.499049 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:39:56.618631 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:56.620268 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:39:56.670810 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Creating config drive at /opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474/disk.config.rescue Jun 26 10:39:56.675162 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplki213_0 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:39:56.758664 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474/disk.config.rescue -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmplki213_0" returned: 0 in 0.083s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:39:57.126249 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:39:57.131430 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] VM Started (Lifecycle Event) Jun 26 10:39:57.253152 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:57.295759 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:57.295759 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:57.301937 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquiring lock "3a56a898-691e-473e-a5c1-d618e861087b" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:57.302335 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "3a56a898-691e-473e-a5c1-d618e861087b" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:57.387762 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:57.449948 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:57.451549 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:57.525685 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-08e86ae2-cd53-47ae-aa33-ca3e96394b4e req-6144e5f5-c1eb-4189-9de1-d95343fc6298 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Received event network-vif-plugged-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:57.525977 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-08e86ae2-cd53-47ae-aa33-ca3e96394b4e req-6144e5f5-c1eb-4189-9de1-d95343fc6298 service nova] Acquiring lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:57.526466 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-08e86ae2-cd53-47ae-aa33-ca3e96394b4e req-6144e5f5-c1eb-4189-9de1-d95343fc6298 service nova] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:57.527076 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-08e86ae2-cd53-47ae-aa33-ca3e96394b4e req-6144e5f5-c1eb-4189-9de1-d95343fc6298 service nova] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:57.527186 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-08e86ae2-cd53-47ae-aa33-ca3e96394b4e req-6144e5f5-c1eb-4189-9de1-d95343fc6298 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] No waiting events found dispatching network-vif-plugged-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:39:57.527389 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-08e86ae2-cd53-47ae-aa33-ca3e96394b4e req-6144e5f5-c1eb-4189-9de1-d95343fc6298 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Received unexpected event network-vif-plugged-93123956-587e-4fec-b4de-833327660f6e for instance with vm_state active and task_state rescuing. Jun 26 10:39:57.533391 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:39:57.632677 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:57.637431 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: b53c3532-08c2-4c05-b5e5-c217d3ef4d9a] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:39:57.806551 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lazy-loading 'flavor' on Instance uuid 3a56a898-691e-473e-a5c1-d618e861087b {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:39:58.266248 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Removed pending STOPPED event for c8aff61a-5f59-4f8c-8288-abd5a7853474 due to new event Resumed> {{(pid=98967) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 26 10:39:58.266752 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:39:58.266752 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] VM Resumed (Lifecycle Event) Jun 26 10:39:58.274144 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-1522f75f-31b3-469c-a7a9-f265eb5ac5c1 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:58.772995 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:58.775787 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: rescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:39:58.839954 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "3a56a898-691e-473e-a5c1-d618e861087b" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.521s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:59.278311 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:39:59.278884 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] VM Started (Lifecycle Event) Jun 26 10:39:59.315271 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "ff80bcea-f14b-4814-98b8-012772daf17e" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:59.315829 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "ff80bcea-f14b-4814-98b8-012772daf17e" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:59.593776 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-6d94a2bb-63f4-4830-ab11-ddef2b4a3e64 req-cbbee745-8619-47f4-8075-878cd3b98cba service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Received event network-vif-plugged-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:39:59.593776 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-6d94a2bb-63f4-4830-ab11-ddef2b4a3e64 req-cbbee745-8619-47f4-8075-878cd3b98cba service nova] Acquiring lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:39:59.593776 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-6d94a2bb-63f4-4830-ab11-ddef2b4a3e64 req-cbbee745-8619-47f4-8075-878cd3b98cba service nova] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:39:59.593776 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-6d94a2bb-63f4-4830-ab11-ddef2b4a3e64 req-cbbee745-8619-47f4-8075-878cd3b98cba service nova] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:39:59.593776 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-6d94a2bb-63f4-4830-ab11-ddef2b4a3e64 req-cbbee745-8619-47f4-8075-878cd3b98cba service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] No waiting events found dispatching network-vif-plugged-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:39:59.593776 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-6d94a2bb-63f4-4830-ab11-ddef2b4a3e64 req-cbbee745-8619-47f4-8075-878cd3b98cba service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Received unexpected event network-vif-plugged-93123956-587e-4fec-b4de-833327660f6e for instance with vm_state rescued and task_state unrescuing. Jun 26 10:39:59.781845 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:39:59.784543 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Synchronizing instance power state after lifecycle event "Started"; current vm_state: rescued, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:39:59.818837 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Starting instance... {{(pid=98967) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 26 10:40:00.020713 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0003655389998584724 future=) submitted to {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:00.021208 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] Emitting event Stopped> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:40:00.021335 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:00.021428 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=5.128527652999992 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:00.021593 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] VM Stopped (Lifecycle Event) Jun 26 10:40:00.022639 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=5.127348120000079 future=) was cancelled while queued, skipping {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:00.022750 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:00.022803 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=8.85393926300003 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:00.022838 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=8.853878070000064 future=) was cancelled while queued, skipping {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:00.022896 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:00.060480 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:00.118540 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-81ad4341-ccff-42fd-8eb4-ee2dce658102 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Unrescuing Jun 26 10:40:00.118540 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquiring lock "3a56a898-691e-473e-a5c1-d618e861087b" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:00.118957 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-81ad4341-ccff-42fd-8eb4-ee2dce658102 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "refresh_cache-c8aff61a-5f59-4f8c-8288-abd5a7853474" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:40:00.119138 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-81ad4341-ccff-42fd-8eb4-ee2dce658102 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquired lock "refresh_cache-c8aff61a-5f59-4f8c-8288-abd5a7853474" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:40:00.119590 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "3a56a898-691e-473e-a5c1-d618e861087b" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:00.119590 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-81ad4341-ccff-42fd-8eb4-ee2dce658102 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:40:00.120532 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Attaching volume 40e55112-eb2e-46ce-ba3b-b050f86c7c24 to /dev/vdb Jun 26 10:40:00.171208 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.79', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003731', 'execute': None}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:40:00.184973 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.scaleio [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98967) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 10:40:00.211040 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Running cmd (subprocess): nvme version {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:00.255337 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] 'nvme version' failed. Not Retrying. {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 10:40:00.255881 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] nvme not present on system {{(pid=98967) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 10:40:00.265003 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98967) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 10:40:00.267632 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.lightos [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Current host hostNQN and IP(s) are ['10.4.3.79', 'fe80::f816:3eff:fe55:ba34', '192.168.40.6', 'fe80::f816:3eff:fe6b:fe1a', '192.168.50.6', 'fe80::f816:3eff:feca:9cd0', '192.168.10.6', 'fe80::f816:3eff:feb4:4e78', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f8bb:38ff:fe28:ff4a', 'fe80::fc16:3eff:fe37:b3f6', 'fe80::41a:feff:fe02:479d', 'fe80::fc16:3eff:fe5e:459', 'fe80::fc16:3eff:fe90:be9c', 'fe80::84cb:23ff:fe8e:e6e6', 'fe80::fc16:3eff:fe5a:811a', 'fe80::fc16:3eff:fe1b:5509', 'fe80::fc16:3eff:fef2:781c', 'fe80::b448:c6ff:fe9c:a1e9', 'fe80::fc16:3eff:fe43:d828', 'fe80::fc16:3eff:fe9c:6906', 'fe80::bc5e:80ff:fe69:218d', 'fe80::fc16:3eff:fefd:1020', 'fe80::fc16:3eff:fe17:f5ed', 'fe80::e4d7:e7ff:fe80:d900', 'fe80::fc16:3eff:feec:35bf', 'fe80::fc16:3eff:fe52:9c9b', 'fe80::fc16:3eff:feac:bc0b', 'fe80::fc16:3eff:feb3:64e7', 'fe80::fc16:3eff:fe6a:a465', 'fe80::6cd3:9eff:fe53:c46c', 'fe80::bc4e:7ff:fef8:a00a', 'fe80::fc16:3eff:fe97:321f', 'fe80::1cb1:31ff:fe57:6a2', 'fe80::fc16:3eff:fe41:2f75', 'fe80::d41a:ddff:fe9f:a411', 'fe80::fc16:3eff:fea4:49e7', 'fe80::acbf:48ff:fe2a:f93b', 'fe80::fc16:3eff:fe0e:19b0', 'fe80::fc16:3eff:fe78:446c'] Jun 26 10:40:00.267998 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 10:40:00.268242 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] LIGHTOS: no hostnqn found. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 10:40:00.268610 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] <== get_connector_properties: return (96ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.79', 'host': 'np0000003731', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:2fddcc2116d6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '7f2a0776-2f14-4357-a22e-baa6677eb22e', 'nvme_native_multipath': False} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:40:00.268998 np0000003731 nova-compute[98967]: DEBUG nova.virt.block_device [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Updating existing volume attachment record: 0e2e8fd5-e2e8-4aa0-8c61-b2000282f22c {{(pid=98967) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 26 10:40:00.286393 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] During sync_power_state the instance has a pending task (unrescuing). Skip. Jun 26 10:40:00.386467 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:00.386717 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:00.392801 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98967) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 26 10:40:00.393076 np0000003731 nova-compute[98967]: INFO nova.compute.claims [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Claim successful on node np0000003731 Jun 26 10:40:00.524488 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:40:00.526112 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Synchronizing instance power state after lifecycle event "Stopped"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 4 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:40:00.624383 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-81ad4341-ccff-42fd-8eb4-ee2dce658102 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:00.825071 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Calling os-brick to attach iSCSI Volume {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 26 10:40:00.825071 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:40:00.825071 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:40:01.028571 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ca8e024f-b6ea-4f47-8485-23e352ebc528 tempest-VolumesAssistedSnapshotsTest-736988545 tempest-VolumesAssistedSnapshotsTest-736988545-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] During sync_power_state the instance has a pending task (resize_finish). Skip. Jun 26 10:40:01.084588 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-81ad4341-ccff-42fd-8eb4-ee2dce658102 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:01.294699 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-81ad4341-ccff-42fd-8eb4-ee2dce658102 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Updating instance_info_cache with network_info: [{"id": "93123956-587e-4fec-b4de-833327660f6e", "address": "fa:16:3e:78:44:6c", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93123956-58", "ovs_interfaceid": "93123956-587e-4fec-b4de-833327660f6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:40:01.798760 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-81ad4341-ccff-42fd-8eb4-ee2dce658102 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Releasing lock "refresh_cache-c8aff61a-5f59-4f8c-8288-abd5a7853474" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:40:01.799388 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-81ad4341-ccff-42fd-8eb4-ee2dce658102 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'flavor' on Instance uuid c8aff61a-5f59-4f8c-8288-abd5a7853474 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:02.116155 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Found WWN 3300000008cbe0377 for multipath device dm-8 {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 26 10:40:02.117525 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 8.051s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:40:02.117525 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] <== connect_volume: return (8051ms) {'type': 'block', 'scsi_wwn': '3300000008cbe0377', 'path': '/dev/dm-8', 'multipath_id': '3300000008cbe0377'} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:40:02.117525 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000008cbe0377', 'path': '/dev/dm-8', 'multipath_id': '3300000008cbe0377'} {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 26 10:40:02.118576 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 1.294s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:40:02.119305 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 10:40:02.133062 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:40:02.133706 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:40:02.134379 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:40:02.134628 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:40:02.137328 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:40:02.137328 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:40:02.149126 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:40:02.149126 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:02.155743 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:40:02.155743 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:02.163981 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24] added Jun 26 10:40:02.163981 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:40:02.163981 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:40:02.163981 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:40:02.163981 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:40:02.163981 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:40:02.163981 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:02.164405 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:40:02.164503 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0298(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:40:02.164753 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:40:02.170366 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24] added Jun 26 10:40:02.170366 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:40:02.170366 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:40:02.170366 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:40:02.170366 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:40:02.170366 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:40:02.170366 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:02.170632 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:40:02.170720 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0355(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:40:02.170848 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:40:02.339746 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:02.348249 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:02.369142 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:02.445153 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:40:02.445153 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:40:02.533554 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:02.540283 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-25e687a1-03f8-484d-8f34-516f7c77facc req-ce5932d3-f79b-4c4f-a931-2923c13bf710 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Received event network-vif-unplugged-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:02.541496 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-25e687a1-03f8-484d-8f34-516f7c77facc req-ce5932d3-f79b-4c4f-a931-2923c13bf710 service nova] Acquiring lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:02.541551 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-25e687a1-03f8-484d-8f34-516f7c77facc req-ce5932d3-f79b-4c4f-a931-2923c13bf710 service nova] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:02.541683 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-25e687a1-03f8-484d-8f34-516f7c77facc req-ce5932d3-f79b-4c4f-a931-2923c13bf710 service nova] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:02.542454 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-25e687a1-03f8-484d-8f34-516f7c77facc req-ce5932d3-f79b-4c4f-a931-2923c13bf710 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] No waiting events found dispatching network-vif-unplugged-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:02.542454 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-25e687a1-03f8-484d-8f34-516f7c77facc req-ce5932d3-f79b-4c4f-a931-2923c13bf710 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Received unexpected event network-vif-unplugged-93123956-587e-4fec-b4de-833327660f6e for instance with vm_state rescued and task_state unrescuing. Jun 26 10:40:02.542622 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:02.549226 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:02.625470 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000003731',hostname='multiattach-server-0',id=14,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIANZiDTtI5cmApVvRJAaLuw+rm1nR4eCOZjHwVoNWhAR53DFExlyLfMWz+jjXnkCXdfpUcLxD2eMk9e+d1HV7SCzQccChfvPKV4jw2Mlc92UdPlKs2IxpAJWXP9L/ysw==',key_name='tempest-keypair-1990365436',keypairs=,launch_index=0,launched_at=2026-06-26T10:38:42Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003731',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='49c2798faed447838b6c87f6d15cce66',ramdisk_id='',reservation_id='r-dloghlmq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1668992443',owner_user_name='tempest-AttachVolumeMultiAttachTest-1668992443-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:39:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a8a0b0240a34fb0bcf62ee7ec259cb2',uuid=c1043abd-b0c0-439e-b065-8bef627483cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "061a7108-6f47-4def-b12d-38eb13d382f6", "address": "fa:16:3e:48:bc:a4", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "vif_mac": "fa:16:3e:48:bc:a4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap061a7108-6f", "ovs_interfaceid": "061a7108-6f47-4def-b12d-38eb13d382f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:40:02.625470 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Converting VIF {"id": "061a7108-6f47-4def-b12d-38eb13d382f6", "address": "fa:16:3e:48:bc:a4", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "vif_mac": "fa:16:3e:48:bc:a4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap061a7108-6f", "ovs_interfaceid": "061a7108-6f47-4def-b12d-38eb13d382f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:40:02.626304 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:bc:a4,bridge_name='br-int',has_traffic_filtering=True,id=061a7108-6f47-4def-b12d-38eb13d382f6,network=Network(204eb6a3-9452-412e-ab0b-1594eb86bed2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap061a7108-6f') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] End _get_guest_xml xml= Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: c1043abd-b0c0-439e-b065-8bef627483cb Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: instance-0000000e Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: 262144 Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: multiattach-server-0 Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: 2026-06-26 10:39:53 Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: 256 Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: 0 Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: 0 Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: True Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: bare Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: 0 Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: ide Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: virtio Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: pc Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: virtio Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: virtio Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: virtio Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: tempest-AttachVolumeMultiAttachTest-1668992443-project-member Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: tempest-AttachVolumeMultiAttachTest-1668992443 Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: c1043abd-b0c0-439e-b065-8bef627483cb Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: c1043abd-b0c0-439e-b065-8bef627483cb Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: hvm Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: 128 Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: 1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: Jun 26 10:40:02.628618 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:40:02.631517 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:27Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-0',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000003731',hostname='multiattach-server-0',id=14,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIANZiDTtI5cmApVvRJAaLuw+rm1nR4eCOZjHwVoNWhAR53DFExlyLfMWz+jjXnkCXdfpUcLxD2eMk9e+d1HV7SCzQccChfvPKV4jw2Mlc92UdPlKs2IxpAJWXP9L/ysw==',key_name='tempest-keypair-1990365436',keypairs=,launch_index=0,launched_at=2026-06-26T10:38:42Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003731',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='49c2798faed447838b6c87f6d15cce66',ramdisk_id='',reservation_id='r-dloghlmq',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1668992443',owner_user_name='tempest-AttachVolumeMultiAttachTest-1668992443-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:39:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a8a0b0240a34fb0bcf62ee7ec259cb2',uuid=c1043abd-b0c0-439e-b065-8bef627483cb,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "061a7108-6f47-4def-b12d-38eb13d382f6", "address": "fa:16:3e:48:bc:a4", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "vif_mac": "fa:16:3e:48:bc:a4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap061a7108-6f", "ovs_interfaceid": "061a7108-6f47-4def-b12d-38eb13d382f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:40:02.631517 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Converting VIF {"id": "061a7108-6f47-4def-b12d-38eb13d382f6", "address": "fa:16:3e:48:bc:a4", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "vif_mac": "fa:16:3e:48:bc:a4"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap061a7108-6f", "ovs_interfaceid": "061a7108-6f47-4def-b12d-38eb13d382f6", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:40:02.631517 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:48:bc:a4,bridge_name='br-int',has_traffic_filtering=True,id=061a7108-6f47-4def-b12d-38eb13d382f6,network=Network(204eb6a3-9452-412e-ab0b-1594eb86bed2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap061a7108-6f') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:40:02.631517 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:bc:a4,bridge_name='br-int',has_traffic_filtering=True,id=061a7108-6f47-4def-b12d-38eb13d382f6,network=Network(204eb6a3-9452-412e-ab0b-1594eb86bed2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap061a7108-6f') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:40:02.631517 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:02.631992 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:02.633248 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:40:02.633854 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:02.634213 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'afe98f24-b8a8-5723-be0d-9ab4a4c13f14', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:02.635339 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:02.636216 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:02.651586 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:02.656562 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:02.657377 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap061a7108-6f, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:02.657564 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap061a7108-6f, col_values=(('qos', UUID('e49e4697-2877-49b3-9b3d-baf3dccd81b0')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:02.657784 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap061a7108-6f, col_values=(('external_ids', {'iface-id': '061a7108-6f47-4def-b12d-38eb13d382f6', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:48:bc:a4', 'vm-uuid': 'c1043abd-b0c0-439e-b065-8bef627483cb'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:02.658932 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:02.661410 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:02.666582 np0000003731 nova-compute[98967]: DEBUG nova.utils [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Queued Task(fn=>, remaining_delay=14.999681070000179 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:02.667053 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.999228562000098 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:02.667325 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.998924299999999 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:02.669596 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Instance destroyed successfully. Jun 26 10:40:02.672409 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:02.674767 np0000003731 nova-compute[98967]: INFO os_vif [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:48:bc:a4,bridge_name='br-int',has_traffic_filtering=True,id=061a7108-6f47-4def-b12d-38eb13d382f6,network=Network(204eb6a3-9452-412e-ab0b-1594eb86bed2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap061a7108-6f') Jun 26 10:40:02.675629 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-81ad4341-ccff-42fd-8eb4-ee2dce658102 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'numa_topology' on Instance uuid c8aff61a-5f59-4f8c-8288-abd5a7853474 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:02.948799 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:40:03.165312 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:40:03.171766 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:40:03.177993 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-81ad4341-ccff-42fd-8eb4-ee2dce658102 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Object Instance lazy-loaded attributes: flavor,numa_topology {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.50.100 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:40:03.182488 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.40.100 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:40:03.190722 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:03.200404 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:03.206695 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:03.229592 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:03.229592 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:03.229592 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:03.229592 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:03.229592 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:03.229592 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:03.229592 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:03.229592 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:03.229592 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:03.229592 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:03.229592 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:03.229592 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:03.229592 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:03.229592 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:03.229592 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:03.229592 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:03.229592 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:40:03.230763 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:03.230763 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:03.230763 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:03.230763 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:03.230763 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:03.230763 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:03.230763 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:03.230763 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:03.230763 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:03.230763 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:03.230763 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:03.230763 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:03.230763 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:03.230763 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:03.230763 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:03.230763 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:03.230763 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:40:03.236379 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:03.236379 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:03.236379 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:03.236379 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:03.236379 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:03.236379 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:03.236379 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:03.236379 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:03.236379 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:03.236379 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:03.236379 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:03.236379 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:03.236379 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:03.236379 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:03.236379 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:03.236379 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:03.236379 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:40:03.237894 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:03.237894 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:03.237894 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:03.237894 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:03.237894 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:03.237894 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:03.237894 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:03.237894 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:03.237894 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:03.237894 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:03.237894 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:03.237894 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:03.237894 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:03.237894 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:03.237894 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:03.237894 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:03.237894 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:40:03.310610 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24, portal: 192.168.50.100,3260] Jun 26 10:40:03.310610 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24, portal: 192.168.50.100,3260] successful. Jun 26 10:40:03.310610 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:03.320601 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24, portal: 192.168.40.100,3260] Jun 26 10:40:03.320601 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24, portal: 192.168.40.100,3260] successful. Jun 26 10:40:03.320601 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:03.326748 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:03.336187 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:03.352252 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:03.352252 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:03.352252 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:03.352252 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:03.352252 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:03.352252 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:03.352252 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:03.352252 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:03.352252 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:03.352252 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:03.352252 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:03.352252 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:03.352252 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:03.352252 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:03.352252 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:03.352252 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:03.352252 np0000003731 nova-compute[98967]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:03.352252 np0000003731 nova-compute[98967]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:03.352252 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:40:03.353330 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:03.353330 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:03.353330 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:03.353330 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:03.353330 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:03.353330 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:03.353330 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:03.353330 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:03.353330 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:03.353330 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:03.353330 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:03.353330 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:03.353330 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:03.353330 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:03.353330 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:03.353330 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:03.353330 np0000003731 nova-compute[98967]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:03.353330 np0000003731 nova-compute[98967]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:03.353330 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:40:03.353330 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.218s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:40:03.353330 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Connected to 192.168.50.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:40:03.354606 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] HCTL ('23', '-', '-', 0) found on session 36 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:40:03.354743 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Scanning host 23 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.228s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:40:03.363139 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Connected to 192.168.40.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:40:03.364717 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] HCTL ('24', '-', '-', 0) found on session 37 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:40:03.364829 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Scanning host 24 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:40:03.375887 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Searching for a device in session 36 and hctl ['23', '*', '*', 0] yield: sdr {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:40:03.375887 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Connected to sdr using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:40:03.393327 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Searching for a device in session 37 and hctl ['24', '*', '*', 0] yield: sds {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:40:03.393327 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Connected to sds using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:40:03.459574 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.073s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:03.460319 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Start building networks asynchronously for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 26 10:40:03.715759 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:03.757466 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:03.762144 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:03.857773 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:03.920529 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:03.927482 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:03.968469 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Allocating IP information in the background. {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 26 10:40:03.968469 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] allocate_for_instance() {{(pid=98967) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 26 10:40:03.968469 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:03.968469 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:04.063699 np0000003731 nova-compute[98967]: DEBUG nova.policy [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72704c563abb412aa2c238092bd55ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea834a26efe148649425d3e02d974ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98967) authorize /opt/stack/nova/nova/policy.py:192}} Jun 26 10:40:04.134958 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 26 10:40:04.202233 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:40:04.202233 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:40:04.202233 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:40:04.202233 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] No VIF found with MAC fa:16:3e:48:bc:a4, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:40:04.202233 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Using config drive Jun 26 10:40:04.482187 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 26 10:40:04.645041 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7f0dc4b6-a519-44bb-8726-281dae17972f req-6686428e-35f7-4d4b-b52b-35871d19f69a service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Received event network-vif-unplugged-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:04.645403 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7f0dc4b6-a519-44bb-8726-281dae17972f req-6686428e-35f7-4d4b-b52b-35871d19f69a service nova] Acquiring lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:04.645612 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7f0dc4b6-a519-44bb-8726-281dae17972f req-6686428e-35f7-4d4b-b52b-35871d19f69a service nova] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:04.645723 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7f0dc4b6-a519-44bb-8726-281dae17972f req-6686428e-35f7-4d4b-b52b-35871d19f69a service nova] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:04.645876 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7f0dc4b6-a519-44bb-8726-281dae17972f req-6686428e-35f7-4d4b-b52b-35871d19f69a service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] No waiting events found dispatching network-vif-unplugged-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:04.646027 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-7f0dc4b6-a519-44bb-8726-281dae17972f req-6686428e-35f7-4d4b-b52b-35871d19f69a service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Received unexpected event network-vif-unplugged-93123956-587e-4fec-b4de-833327660f6e for instance with vm_state rescued and task_state unrescuing. Jun 26 10:40:04.646151 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7f0dc4b6-a519-44bb-8726-281dae17972f req-6686428e-35f7-4d4b-b52b-35871d19f69a service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Received event network-vif-plugged-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:04.646289 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7f0dc4b6-a519-44bb-8726-281dae17972f req-6686428e-35f7-4d4b-b52b-35871d19f69a service nova] Acquiring lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:04.646418 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7f0dc4b6-a519-44bb-8726-281dae17972f req-6686428e-35f7-4d4b-b52b-35871d19f69a service nova] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:04.646524 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7f0dc4b6-a519-44bb-8726-281dae17972f req-6686428e-35f7-4d4b-b52b-35871d19f69a service nova] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:04.646633 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7f0dc4b6-a519-44bb-8726-281dae17972f req-6686428e-35f7-4d4b-b52b-35871d19f69a service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] No waiting events found dispatching network-vif-plugged-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:04.646744 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-7f0dc4b6-a519-44bb-8726-281dae17972f req-6686428e-35f7-4d4b-b52b-35871d19f69a service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Received unexpected event network-vif-plugged-93123956-587e-4fec-b4de-833327660f6e for instance with vm_state rescued and task_state unrescuing. Jun 26 10:40:04.646848 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7f0dc4b6-a519-44bb-8726-281dae17972f req-6686428e-35f7-4d4b-b52b-35871d19f69a service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Received event network-vif-plugged-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:04.646980 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7f0dc4b6-a519-44bb-8726-281dae17972f req-6686428e-35f7-4d4b-b52b-35871d19f69a service nova] Acquiring lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:04.647130 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7f0dc4b6-a519-44bb-8726-281dae17972f req-6686428e-35f7-4d4b-b52b-35871d19f69a service nova] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:04.647242 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7f0dc4b6-a519-44bb-8726-281dae17972f req-6686428e-35f7-4d4b-b52b-35871d19f69a service nova] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:04.647353 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7f0dc4b6-a519-44bb-8726-281dae17972f req-6686428e-35f7-4d4b-b52b-35871d19f69a service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] No waiting events found dispatching network-vif-plugged-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:04.647463 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-7f0dc4b6-a519-44bb-8726-281dae17972f req-6686428e-35f7-4d4b-b52b-35871d19f69a service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Received unexpected event network-vif-plugged-93123956-587e-4fec-b4de-833327660f6e for instance with vm_state rescued and task_state unrescuing. Jun 26 10:40:04.663996 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Successfully created port: 7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:40:04.719567 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:04.758479 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:04.779105 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Removed pending STOPPED event for c8aff61a-5f59-4f8c-8288-abd5a7853474 due to new event Resumed> {{(pid=98967) _event_emit_delayed /opt/stack/nova/nova/virt/libvirt/host.py:519}} Jun 26 10:40:04.779105 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:40:04.779105 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] VM Resumed (Lifecycle Event) Jun 26 10:40:04.784610 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-81ad4341-ccff-42fd-8eb4-ee2dce658102 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:40:04.875434 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:04.928912 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:04.986309 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Start building block device mappings for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 26 10:40:05.152999 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Found WWN 330000000e9c36c73 for multipath device dm-14 {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 26 10:40:05.153226 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.035s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:40:05.153386 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] <== connect_volume: return (4328ms) {'type': 'block', 'scsi_wwn': '330000000e9c36c73', 'path': '/dev/dm-14', 'multipath_id': '330000000e9c36c73'} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:40:05.153504 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e9c36c73', 'path': '/dev/dm-14', 'multipath_id': '330000000e9c36c73'} {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 26 10:40:05.157174 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lazy-loading 'flavor' on Instance uuid 3a56a898-691e-473e-a5c1-d618e861087b {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:05.284446 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:40:05.286914 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: rescued, current task_state: unrescuing, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:40:05.361671 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Successfully updated port: 7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:40:05.413969 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-c69d11f7-3516-4ac5-8929-e86a3d0b2a25 req-b70541d1-11ab-4766-910b-cff4c09e9746 service nova] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Received event network-changed-7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:05.414150 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-c69d11f7-3516-4ac5-8929-e86a3d0b2a25 req-b70541d1-11ab-4766-910b-cff4c09e9746 service nova] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Refreshing instance network info cache due to event network-changed-7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:40:05.415018 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c69d11f7-3516-4ac5-8929-e86a3d0b2a25 req-b70541d1-11ab-4766-910b-cff4c09e9746 service nova] Acquiring lock "refresh_cache-ff80bcea-f14b-4814-98b8-012772daf17e" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:40:05.415145 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c69d11f7-3516-4ac5-8929-e86a3d0b2a25 req-b70541d1-11ab-4766-910b-cff4c09e9746 service nova] Acquired lock "refresh_cache-ff80bcea-f14b-4814-98b8-012772daf17e" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:40:05.415549 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-c69d11f7-3516-4ac5-8929-e86a3d0b2a25 req-b70541d1-11ab-4766-910b-cff4c09e9746 service nova] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Refreshing network info cache for port 7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:40:05.660361 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Attempting to attach volume 40e55112-eb2e-46ce-ba3b-b050f86c7c24 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98967) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 26 10:40:05.661753 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] attach device xml: Jun 26 10:40:05.661753 np0000003731 nova-compute[98967]: Jun 26 10:40:05.661753 np0000003731 nova-compute[98967]: Jun 26 10:40:05.661753 np0000003731 nova-compute[98967]: Jun 26 10:40:05.661753 np0000003731 nova-compute[98967]: Jun 26 10:40:05.661753 np0000003731 nova-compute[98967]: 40e55112-eb2e-46ce-ba3b-b050f86c7c24 Jun 26 10:40:05.661753 np0000003731 nova-compute[98967]: Jun 26 10:40:05.661753 np0000003731 nova-compute[98967]: {{(pid=98967) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 26 10:40:05.760637 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Instance event wait completed in 0 seconds for {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:40:05.763427 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Instance running successfully. Jun 26 10:40:05.764855 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Failed to set time: agent not configured {{(pid=98967) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}} Jun 26 10:40:05.764855 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-f825ba3d-6058-43e2-98a4-5ba897b6b261 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] finish_migration finished successfully. {{(pid=98967) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12903}} Jun 26 10:40:05.793909 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:40:05.794175 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] VM Started (Lifecycle Event) Jun 26 10:40:05.863927 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "refresh_cache-ff80bcea-f14b-4814-98b8-012772daf17e" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:40:05.917388 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-c69d11f7-3516-4ac5-8929-e86a3d0b2a25 req-b70541d1-11ab-4766-910b-cff4c09e9746 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:05.983014 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-c69d11f7-3516-4ac5-8929-e86a3d0b2a25 req-b70541d1-11ab-4766-910b-cff4c09e9746 service nova] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:40:05.997653 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Start spawning the instance on the hypervisor. {{(pid=98967) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 26 10:40:05.998977 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Creating instance directory {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 26 10:40:05.999204 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Creating image(s) Jun 26 10:40:05.999636 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "/opt/stack/data/nova/instances/ff80bcea-f14b-4814-98b8-012772daf17e/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:06.000032 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "/opt/stack/data/nova/instances/ff80bcea-f14b-4814-98b8-012772daf17e/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:06.000486 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "/opt/stack/data/nova/instances/ff80bcea-f14b-4814-98b8-012772daf17e/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:06.000970 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:40:06.004286 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:40:06.007058 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:06.120231 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.113s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:06.120772 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:06.121395 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:06.122416 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:40:06.125691 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:40:06.126120 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:06.235772 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-c69d11f7-3516-4ac5-8929-e86a3d0b2a25 req-b70541d1-11ab-4766-910b-cff4c09e9746 service nova] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:40:06.247329 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.121s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:06.247824 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/ff80bcea-f14b-4814-98b8-012772daf17e/disk 1073741824 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:06.298380 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:40:06.303436 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Synchronizing instance power state after lifecycle event "Started"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:40:06.318503 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/ff80bcea-f14b-4814-98b8-012772daf17e/disk 1073741824" returned: 0 in 0.071s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:06.318861 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "e5b93853a20f0423d15ef4670655d4cbba0b72fe" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.197s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:06.319372 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:06.432997 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.113s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:06.433537 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Checking if we can resize image /opt/stack/data/nova/instances/ff80bcea-f14b-4814-98b8-012772daf17e/disk. size=1073741824 {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 26 10:40:06.433911 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff80bcea-f14b-4814-98b8-012772daf17e/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:06.537422 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff80bcea-f14b-4814-98b8-012772daf17e/disk --force-share --output=json" returned: 0 in 0.103s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:06.538516 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Cannot resize image /opt/stack/data/nova/instances/ff80bcea-f14b-4814-98b8-012772daf17e/disk to a smaller size. {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 26 10:40:06.539453 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Created local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 26 10:40:06.539453 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Ensure instance console log exists: /opt/stack/data/nova/instances/ff80bcea-f14b-4814-98b8-012772daf17e/console.log {{(pid=98967) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 26 10:40:06.539680 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:06.540813 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:06.540813 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:06.744506 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-fc18afff-34a2-4ba6-952b-983973e2d811 req-d916d3ba-794c-49d1-b17f-6fd9a9ddfdc8 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Received event network-vif-plugged-061a7108-6f47-4def-b12d-38eb13d382f6 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:06.745095 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-fc18afff-34a2-4ba6-952b-983973e2d811 req-d916d3ba-794c-49d1-b17f-6fd9a9ddfdc8 service nova] Acquiring lock "c1043abd-b0c0-439e-b065-8bef627483cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:06.748472 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-fc18afff-34a2-4ba6-952b-983973e2d811 req-d916d3ba-794c-49d1-b17f-6fd9a9ddfdc8 service nova] Lock "c1043abd-b0c0-439e-b065-8bef627483cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.004s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:06.749571 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-fc18afff-34a2-4ba6-952b-983973e2d811 req-d916d3ba-794c-49d1-b17f-6fd9a9ddfdc8 service nova] Lock "c1043abd-b0c0-439e-b065-8bef627483cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:06.751764 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-fc18afff-34a2-4ba6-952b-983973e2d811 req-d916d3ba-794c-49d1-b17f-6fd9a9ddfdc8 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] No waiting events found dispatching network-vif-plugged-061a7108-6f47-4def-b12d-38eb13d382f6 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:06.752275 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-fc18afff-34a2-4ba6-952b-983973e2d811 req-d916d3ba-794c-49d1-b17f-6fd9a9ddfdc8 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Received unexpected event network-vif-plugged-061a7108-6f47-4def-b12d-38eb13d382f6 for instance with vm_state resized and task_state None. Jun 26 10:40:06.752275 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-fc18afff-34a2-4ba6-952b-983973e2d811 req-d916d3ba-794c-49d1-b17f-6fd9a9ddfdc8 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Received event network-vif-plugged-061a7108-6f47-4def-b12d-38eb13d382f6 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:06.753529 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-fc18afff-34a2-4ba6-952b-983973e2d811 req-d916d3ba-794c-49d1-b17f-6fd9a9ddfdc8 service nova] Acquiring lock "c1043abd-b0c0-439e-b065-8bef627483cb-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:06.758507 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-fc18afff-34a2-4ba6-952b-983973e2d811 req-d916d3ba-794c-49d1-b17f-6fd9a9ddfdc8 service nova] Lock "c1043abd-b0c0-439e-b065-8bef627483cb-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.006s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:06.758774 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-fc18afff-34a2-4ba6-952b-983973e2d811 req-d916d3ba-794c-49d1-b17f-6fd9a9ddfdc8 service nova] Lock "c1043abd-b0c0-439e-b065-8bef627483cb-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:06.759545 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-fc18afff-34a2-4ba6-952b-983973e2d811 req-d916d3ba-794c-49d1-b17f-6fd9a9ddfdc8 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] No waiting events found dispatching network-vif-plugged-061a7108-6f47-4def-b12d-38eb13d382f6 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:06.759828 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-fc18afff-34a2-4ba6-952b-983973e2d811 req-d916d3ba-794c-49d1-b17f-6fd9a9ddfdc8 service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Received unexpected event network-vif-plugged-061a7108-6f47-4def-b12d-38eb13d382f6 for instance with vm_state resized and task_state None. Jun 26 10:40:06.760809 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-c69d11f7-3516-4ac5-8929-e86a3d0b2a25 req-b70541d1-11ab-4766-910b-cff4c09e9746 service nova] Releasing lock "refresh_cache-ff80bcea-f14b-4814-98b8-012772daf17e" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:40:06.761695 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquired lock "refresh_cache-ff80bcea-f14b-4814-98b8-012772daf17e" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:40:06.761902 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:40:06.809833 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:40:06.810872 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] VM Resumed (Lifecycle Event) Jun 26 10:40:07.112987 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._reclaim_queued_deletes {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:40:07.113228 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CONF.reclaim_instance_interval <= 0, skipping... {{(pid=98967) _reclaim_queued_deletes /opt/stack/nova/nova/compute/manager.py:11402}} Jun 26 10:40:07.114615 np0000003731 nova-compute[98967]: DEBUG oslo.service.backend._threading.loopingcall [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 1.00 seconds {{(pid=98967) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 26 10:40:07.316075 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:40:07.322126 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:40:07.354946 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:40:07.355477 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:40:07.355477 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:40:07.355477 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] No VIF found with MAC fa:16:3e:9c:69:06, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:40:07.382624 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:40:07.540022 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-354ba9b1-519c-46b5-84fe-b34ef8f213ad req-4db6e5c0-12c1-4836-a6cd-47146b983fb1 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Received event network-changed-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:07.540022 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-354ba9b1-519c-46b5-84fe-b34ef8f213ad req-4db6e5c0-12c1-4836-a6cd-47146b983fb1 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Refreshing instance network info cache due to event network-changed-93123956-587e-4fec-b4de-833327660f6e. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:40:07.540022 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-354ba9b1-519c-46b5-84fe-b34ef8f213ad req-4db6e5c0-12c1-4836-a6cd-47146b983fb1 service nova] Acquiring lock "refresh_cache-c8aff61a-5f59-4f8c-8288-abd5a7853474" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:40:07.540022 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-354ba9b1-519c-46b5-84fe-b34ef8f213ad req-4db6e5c0-12c1-4836-a6cd-47146b983fb1 service nova] Acquired lock "refresh_cache-c8aff61a-5f59-4f8c-8288-abd5a7853474" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:40:07.540022 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-354ba9b1-519c-46b5-84fe-b34ef8f213ad req-4db6e5c0-12c1-4836-a6cd-47146b983fb1 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Refreshing network info cache for port 93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:40:07.540022 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:07.646035 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:07.659903 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:07.814752 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-30b06554-4bb2-4ae1-9eca-239ecf90faa9 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "c1043abd-b0c0-439e-b065-8bef627483cb" by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:07.815381 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-30b06554-4bb2-4ae1-9eca-239ecf90faa9 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "c1043abd-b0c0-439e-b065-8bef627483cb" acquired by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:07.815539 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-30b06554-4bb2-4ae1-9eca-239ecf90faa9 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Going to confirm migration 1 {{(pid=98967) do_confirm_resize /opt/stack/nova/nova/compute/manager.py:5452}} Jun 26 10:40:07.821984 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Updating instance_info_cache with network_info: [{"id": "7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc", "address": "fa:16:3e:85:e3:e8", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee68f0a-8d", "ovs_interfaceid": "7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:40:07.828934 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:40:07.829106 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] VM Started (Lifecycle Event) Jun 26 10:40:08.051569 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-354ba9b1-519c-46b5-84fe-b34ef8f213ad req-4db6e5c0-12c1-4836-a6cd-47146b983fb1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:08.113414 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager.update_available_resource {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:40:08.321757 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-30b06554-4bb2-4ae1-9eca-239ecf90faa9 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:08.324328 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Releasing lock "refresh_cache-ff80bcea-f14b-4814-98b8-012772daf17e" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:40:08.325166 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Instance network_info: |[{"id": "7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc", "address": "fa:16:3e:85:e3:e8", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee68f0a-8d", "ovs_interfaceid": "7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 26 10:40:08.326694 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Start _get_guest_xml network_info=[{"id": "7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc", "address": "fa:16:3e:85:e3:e8", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee68f0a-8d", "ovs_interfaceid": "7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'image_id': 'a9b18127-6fee-4ed6-b364-a2d634ecb8b7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:40:08.330088 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:40:08.331597 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-564107872', uuid='ff80bcea-f14b-4814-98b8-012772daf17e'), owner=OwnerMeta(userid='72704c563abb412aa2c238092bd55ec4', username='tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member', projectid='ea834a26efe148649425d3e02d974ef4', projectname='tempest-ServerBootFromVolumeStableRescueTest-618712607'), image=ImageMeta(id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc", "address": "fa:16:3e:85:e3:e8", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee68f0a-8d", "ovs_interfaceid": "7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470408.3312213) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:40:08.333493 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:40:08.338871 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:40:08.340431 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:40:08.341590 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:40:08.350665 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:40:08.350665 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:40:08.350665 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:40:08.350665 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:40:08.350665 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:40:08.350665 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:40:08.351324 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:40:08.351638 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:40:08.351886 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:40:08.352223 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:40:08.352478 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:40:08.352724 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:40:08.352986 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:40:08.353264 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:40:08.386140 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-564107872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-serverbootfromvolumestablerescuetest-server-564107872',id=24,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea834a26efe148649425d3e02d974ef4',ramdisk_id='',reservation_id='r-8zls1b57',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-618712607',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:40:05Z,user_data=None,user_id='72704c563abb412aa2c238092bd55ec4',uuid=ff80bcea-f14b-4814-98b8-012772daf17e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc", "address": "fa:16:3e:85:e3:e8", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee68f0a-8d", "ovs_interfaceid": "7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:40:08.386140 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Converting VIF {"id": "7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc", "address": "fa:16:3e:85:e3:e8", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee68f0a-8d", "ovs_interfaceid": "7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:40:08.386140 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:e3:e8,bridge_name='br-int',has_traffic_filtering=True,id=7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc,network=Network(67c50821-8012-4a48-8c3a-b0cc3d2ddcb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee68f0a-8d') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:40:08.388992 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lazy-loading 'pci_devices' on Instance uuid ff80bcea-f14b-4814-98b8-012772daf17e {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:08.521083 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-30b06554-4bb2-4ae1-9eca-239ecf90faa9 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:08.521425 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-30b06554-4bb2-4ae1-9eca-239ecf90faa9 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "refresh_cache-c1043abd-b0c0-439e-b065-8bef627483cb" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:40:08.521525 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-30b06554-4bb2-4ae1-9eca-239ecf90faa9 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquired lock "refresh_cache-c1043abd-b0c0-439e-b065-8bef627483cb" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:40:08.521642 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-30b06554-4bb2-4ae1-9eca-239ecf90faa9 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:40:08.521844 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-30b06554-4bb2-4ae1-9eca-239ecf90faa9 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lazy-loading 'info_cache' on Instance uuid c1043abd-b0c0-439e-b065-8bef627483cb {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:08.527065 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-354ba9b1-519c-46b5-84fe-b34ef8f213ad req-4db6e5c0-12c1-4836-a6cd-47146b983fb1 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:08.619490 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:08.625837 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: waited 0.005s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:08.625837 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.clean_compute_node_cache" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:08.625837 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Auditing locally available compute resources for np0000003731 (node: np0000003731) {{(pid=98967) update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:937}} Jun 26 10:40:08.723158 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-354ba9b1-519c-46b5-84fe-b34ef8f213ad req-4db6e5c0-12c1-4836-a6cd-47146b983fb1 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Updated VIF entry in instance network info cache for port 93123956-587e-4fec-b4de-833327660f6e. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:40:08.723511 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-354ba9b1-519c-46b5-84fe-b34ef8f213ad req-4db6e5c0-12c1-4836-a6cd-47146b983fb1 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Updating instance_info_cache with network_info: [{"id": "93123956-587e-4fec-b4de-833327660f6e", "address": "fa:16:3e:78:44:6c", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93123956-58", "ovs_interfaceid": "93123956-587e-4fec-b4de-833327660f6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] End _get_guest_xml xml= Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: ff80bcea-f14b-4814-98b8-012772daf17e Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: instance-00000018 Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: 196608 Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: tempest-ServerBootFromVolumeStableRescueTest-server-564107872 Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: 2026-06-26 10:40:08 Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: 192 Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: 0 Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: 0 Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: True Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: bare Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: 0 Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: virtio Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: tempest-ServerBootFromVolumeStableRescueTest-618712607 Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: ff80bcea-f14b-4814-98b8-012772daf17e Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: ff80bcea-f14b-4814-98b8-012772daf17e Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: hvm Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: 128 Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: Jun 26 10:40:08.893841 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:40:08.897407 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Preparing to wait for external event network-vif-plugged-7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:40:08.897407 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "ff80bcea-f14b-4814-98b8-012772daf17e-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:08.897407 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "ff80bcea-f14b-4814-98b8-012772daf17e-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:08.897407 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "ff80bcea-f14b-4814-98b8-012772daf17e-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:08.897407 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:39:58Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-564107872',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-serverbootfromvolumestablerescuetest-server-564107872',id=24,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea834a26efe148649425d3e02d974ef4',ramdisk_id='',reservation_id='r-8zls1b57',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-618712607',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:40:05Z,user_data=None,user_id='72704c563abb412aa2c238092bd55ec4',uuid=ff80bcea-f14b-4814-98b8-012772daf17e,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc", "address": "fa:16:3e:85:e3:e8", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee68f0a-8d", "ovs_interfaceid": "7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:40:08.897407 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Converting VIF {"id": "7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc", "address": "fa:16:3e:85:e3:e8", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.14", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap7ee68f0a-8d", "ovs_interfaceid": "7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:40:08.897407 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:85:e3:e8,bridge_name='br-int',has_traffic_filtering=True,id=7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc,network=Network(67c50821-8012-4a48-8c3a-b0cc3d2ddcb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee68f0a-8d') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:40:08.897407 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:e3:e8,bridge_name='br-int',has_traffic_filtering=True,id=7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc,network=Network(67c50821-8012-4a48-8c3a-b0cc3d2ddcb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee68f0a-8d') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:40:08.897802 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:08.897951 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:08.898235 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:40:08.899803 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:08.900000 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '00ee06d2-560d-5f97-9ef7-fc7df5cb3a8b', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:08.900847 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:08.901633 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:08.903032 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:08.906067 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:08.906219 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap7ee68f0a-8d, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:08.906603 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap7ee68f0a-8d, col_values=(('qos', UUID('2438ea99-efd8-419c-a723-66c18b8a122e')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:08.906786 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap7ee68f0a-8d, col_values=(('external_ids', {'iface-id': '7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:85:e3:e8', 'vm-uuid': 'ff80bcea-f14b-4814-98b8-012772daf17e'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:08.907898 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:08.909411 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:08.916414 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:08.917682 np0000003731 nova-compute[98967]: INFO os_vif [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:85:e3:e8,bridge_name='br-int',has_traffic_filtering=True,id=7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc,network=Network(67c50821-8012-4a48-8c3a-b0cc3d2ddcb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap7ee68f0a-8d') Jun 26 10:40:08.948073 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-e15e1040-664f-4b15-8f1f-c244ff4c7f59 tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "3a56a898-691e-473e-a5c1-d618e861087b" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 8.829s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:09.226552 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-354ba9b1-519c-46b5-84fe-b34ef8f213ad req-4db6e5c0-12c1-4836-a6cd-47146b983fb1 service nova] Releasing lock "refresh_cache-c8aff61a-5f59-4f8c-8288-abd5a7853474" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:40:09.527073 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-30b06554-4bb2-4ae1-9eca-239ecf90faa9 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:09.626484 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-116ecf91-da8f-4f76-914a-25444409a4d3 req-21226c82-5438-40c5-a704-76f6d4b407c7 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Received event network-changed-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:09.626721 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-116ecf91-da8f-4f76-914a-25444409a4d3 req-21226c82-5438-40c5-a704-76f6d4b407c7 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Refreshing instance network info cache due to event network-changed-93123956-587e-4fec-b4de-833327660f6e. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:40:09.628213 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-116ecf91-da8f-4f76-914a-25444409a4d3 req-21226c82-5438-40c5-a704-76f6d4b407c7 service nova] Acquiring lock "refresh_cache-c8aff61a-5f59-4f8c-8288-abd5a7853474" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:40:09.628405 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-116ecf91-da8f-4f76-914a-25444409a4d3 req-21226c82-5438-40c5-a704-76f6d4b407c7 service nova] Acquired lock "refresh_cache-c8aff61a-5f59-4f8c-8288-abd5a7853474" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:40:09.628575 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-116ecf91-da8f-4f76-914a-25444409a4d3 req-21226c82-5438-40c5-a704-76f6d4b407c7 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Refreshing network info cache for port 93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:40:09.683498 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:09.784531 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578/disk --force-share --output=json" returned: 0 in 0.100s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:09.785061 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:09.895864 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:09.900817 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk.rescue --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:09.987779 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-30b06554-4bb2-4ae1-9eca-239ecf90faa9 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:10.015578 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk.rescue --force-share --output=json" returned: 0 in 0.115s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:10.016309 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk.rescue --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:10.129771 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk.rescue --force-share --output=json" returned: 0 in 0.113s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:10.130337 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:10.156970 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-116ecf91-da8f-4f76-914a-25444409a4d3 req-21226c82-5438-40c5-a704-76f6d4b407c7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:10.212271 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-30b06554-4bb2-4ae1-9eca-239ecf90faa9 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Updating instance_info_cache with network_info: [{"id": "061a7108-6f47-4def-b12d-38eb13d382f6", "address": "fa:16:3e:48:bc:a4", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap061a7108-6f", "ovs_interfaceid": "061a7108-6f47-4def-b12d-38eb13d382f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:40:10.244328 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk --force-share --output=json" returned: 0 in 0.113s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:10.245098 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:10.358891 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/25b12be8-e92b-4705-b668-05cfecaf66b3/disk --force-share --output=json" returned: 0 in 0.114s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:10.363793 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:10.446145 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:40:10.446303 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:40:10.446438 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] No VIF found with MAC fa:16:3e:85:e3:e8, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:40:10.447212 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Using config drive Jun 26 10:40:10.469147 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:10.471444 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:10.579576 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/047061b2-340c-4cc9-899b-0744dad0081f/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:10.584844 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:10.657044 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-116ecf91-da8f-4f76-914a-25444409a4d3 req-21226c82-5438-40c5-a704-76f6d4b407c7 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:10.674251 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk --force-share --output=json" returned: 0 in 0.089s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:10.674807 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:10.718905 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-30b06554-4bb2-4ae1-9eca-239ecf90faa9 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Releasing lock "refresh_cache-c1043abd-b0c0-439e-b065-8bef627483cb" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:40:10.719429 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-30b06554-4bb2-4ae1-9eca-239ecf90faa9 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lazy-loading 'migration_context' on Instance uuid c1043abd-b0c0-439e-b065-8bef627483cb {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:10.776930 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c1043abd-b0c0-439e-b065-8bef627483cb/disk --force-share --output=json" returned: 0 in 0.102s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:10.777407 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] skipping disk /dev/dm-8 (vdb) as it is a volume {{(pid=98967) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 26 10:40:10.787057 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:10.893772 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:10.894381 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:10.897665 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-116ecf91-da8f-4f76-914a-25444409a4d3 req-21226c82-5438-40c5-a704-76f6d4b407c7 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Updated VIF entry in instance network info cache for port 93123956-587e-4fec-b4de-833327660f6e. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:40:10.899946 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-116ecf91-da8f-4f76-914a-25444409a4d3 req-21226c82-5438-40c5-a704-76f6d4b407c7 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Updating instance_info_cache with network_info: [{"id": "93123956-587e-4fec-b4de-833327660f6e", "address": "fa:16:3e:78:44:6c", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93123956-58", "ovs_interfaceid": "93123956-587e-4fec-b4de-833327660f6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:40:10.956942 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:10.992847 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk --force-share --output=json" returned: 0 in 0.098s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:10.993231 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] skipping disk /dev/dm-14 (vdb) as it is a volume {{(pid=98967) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 26 10:40:10.996191 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:11.084321 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474/disk --force-share --output=json" returned: 0 in 0.088s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:11.084754 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:11.137874 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Creating config drive at /opt/stack/data/nova/instances/ff80bcea-f14b-4814-98b8-012772daf17e/disk.config Jun 26 10:40:11.142980 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/ff80bcea-f14b-4814-98b8-012772daf17e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp19vlaaq_ {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:11.185694 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474/disk --force-share --output=json" returned: 0 in 0.101s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:11.191735 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] skipping disk /dev/dm-13 (vdb) as it is a volume {{(pid=98967) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 26 10:40:11.193472 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/ff80bcea-f14b-4814-98b8-012772daf17e/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp19vlaaq_" returned: 0 in 0.050s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:11.195103 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ae0d213-f58c-4ee5-844f-960b16a5a95b/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:11.231032 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-30b06554-4bb2-4ae1-9eca-239ecf90faa9 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Object Instance lazy-loaded attributes: info_cache,migration_context {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:40:11.238123 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-30b06554-4bb2-4ae1-9eca-239ecf90faa9 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:11.239516 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-30b06554-4bb2-4ae1-9eca-239ecf90faa9 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:11.302258 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ae0d213-f58c-4ee5-844f-960b16a5a95b/disk --force-share --output=json" returned: 0 in 0.107s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:11.302821 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ae0d213-f58c-4ee5-844f-960b16a5a95b/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:11.408722 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/0ae0d213-f58c-4ee5-844f-960b16a5a95b/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:11.414568 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-116ecf91-da8f-4f76-914a-25444409a4d3 req-21226c82-5438-40c5-a704-76f6d4b407c7 service nova] Releasing lock "refresh_cache-c8aff61a-5f59-4f8c-8288-abd5a7853474" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:40:11.415138 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] skipping disk /dev/dm-10 (vda) as it is a volume {{(pid=98967) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 26 10:40:11.417311 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] skipping disk /dev/dm-0 (vda) as it is a volume {{(pid=98967) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 26 10:40:11.419796 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4a4a7e-d584-427e-91d2-7d9e710ea2a3/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:11.529929 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4a4a7e-d584-427e-91d2-7d9e710ea2a3/disk --force-share --output=json" returned: 0 in 0.110s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:11.530618 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4a4a7e-d584-427e-91d2-7d9e710ea2a3/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:11.623780 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/4b4a4a7e-d584-427e-91d2-7d9e710ea2a3/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:11.628914 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:11.702476 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Stashing vm_state: active {{(pid=98967) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}} Jun 26 10:40:11.713339 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/disk --force-share --output=json" returned: 0 in 0.084s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:11.713823 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:11.750681 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:11.792494 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:11.797109 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:11.819916 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:11.820956 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] skipping disk /dev/dm-8 (vdb) as it is a volume {{(pid=98967) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 26 10:40:11.825648 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212147b0-26de-42cd-b43d-057ec8d61c72/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:11.913617 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:11.949809 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212147b0-26de-42cd-b43d-057ec8d61c72/disk --force-share --output=json" returned: 0 in 0.124s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:11.950403 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212147b0-26de-42cd-b43d-057ec8d61c72/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:11.984936 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:12.051869 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-090d96f2-7126-428a-8810-d8ecc3e4fc13 req-9dd760ce-eac2-4bf2-89ac-0aab91be7c34 service nova] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Received event network-vif-plugged-7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:12.052250 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-090d96f2-7126-428a-8810-d8ecc3e4fc13 req-9dd760ce-eac2-4bf2-89ac-0aab91be7c34 service nova] Acquiring lock "ff80bcea-f14b-4814-98b8-012772daf17e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:12.052495 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-090d96f2-7126-428a-8810-d8ecc3e4fc13 req-9dd760ce-eac2-4bf2-89ac-0aab91be7c34 service nova] Lock "ff80bcea-f14b-4814-98b8-012772daf17e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:12.052724 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-090d96f2-7126-428a-8810-d8ecc3e4fc13 req-9dd760ce-eac2-4bf2-89ac-0aab91be7c34 service nova] Lock "ff80bcea-f14b-4814-98b8-012772daf17e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:12.053131 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-090d96f2-7126-428a-8810-d8ecc3e4fc13 req-9dd760ce-eac2-4bf2-89ac-0aab91be7c34 service nova] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Processing event network-vif-plugged-7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:40:12.056368 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/212147b0-26de-42cd-b43d-057ec8d61c72/disk --force-share --output=json" returned: 0 in 0.106s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:12.062501 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] skipping disk /dev/dm-3 (vda) as it is a volume {{(pid=98967) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 26 10:40:12.063343 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] skipping disk /dev/dm-6 (vdb) as it is a volume {{(pid=98967) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 26 10:40:12.063343 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] skipping disk /dev/dm-7 (vdc) as it is a volume {{(pid=98967) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 26 10:40:12.066620 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] skipping disk /dev/dm-9 (vda) as it is a volume {{(pid=98967) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 26 10:40:12.069501 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/619d915a-12c9-424f-8c12-b2a3f94a4109/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:12.178110 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/619d915a-12c9-424f-8c12-b2a3f94a4109/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:12.178846 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/619d915a-12c9-424f-8c12-b2a3f94a4109/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:12.288649 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/619d915a-12c9-424f-8c12-b2a3f94a4109/disk --force-share --output=json" returned: 0 in 0.109s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:12.299335 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:40:12.300723 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running cmd (subprocess): env LANG=C uptime {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:12.337619 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:12.353020 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] CMD "env LANG=C uptime" returned: 0 in 0.052s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:12.355875 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Hypervisor/Node resource view: name=np0000003731 free_ram=48051MB free_disk=73.85123825073242GB free_vcpus=1 pci_devices=[{"dev_id": "pci_0000_00_1f_2", "address": "0000:00:1f.2", "product_id": "2922", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2922", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_3", "address": "0000:00:1f.3", "product_id": "2930", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2930", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_2", "address": "0000:00:02.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_04_00_0", "address": "0000:04:00.0", "product_id": "1048", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1048", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_7", "address": "0000:00:03.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_3", "address": "0000:00:02.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_08_00_0", "address": "0000:08:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_01_00_0", "address": "0000:01:00.0", "product_id": "000e", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000e", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_6", "address": "0000:00:02.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_5", "address": "0000:00:03.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_3", "address": "0000:00:03.3", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_1", "address": "0000:00:02.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_03_00_0", "address": "0000:03:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_04_0", "address": "0000:00:04.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_0", "address": "0000:00:03.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_4", "address": "0000:00:03.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_09_00_0", "address": "0000:09:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_06_00_0", "address": "0000:06:00.0", "product_id": "1044", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1044", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_05_00_0", "address": "0000:05:00.0", "product_id": "1045", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1045", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_7", "address": "0000:00:02.7", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_02_01_0", "address": "0000:02:01.0", "product_id": "7020", "vendor_id": "8086", "numa_node": null, "label": "label_8086_7020", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_4", "address": "0000:00:02.4", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_5", "address": "0000:00:02.5", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_00_0", "address": "0000:00:00.0", "product_id": "29c0", "vendor_id": "8086", "numa_node": null, "label": "label_8086_29c0", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_07_00_0", "address": "0000:07:00.0", "product_id": "1041", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1041", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_2", "address": "0000:00:03.2", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_01_0", "address": "0000:00:01.0", "product_id": "1050", "vendor_id": "1af4", "numa_node": null, "label": "label_1af4_1050", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_02_0", "address": "0000:00:02.0", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_1", "address": "0000:00:03.1", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_1f_0", "address": "0000:00:1f.0", "product_id": "2918", "vendor_id": "8086", "numa_node": null, "label": "label_8086_2918", "dev_type": "type-PCI"}, {"dev_id": "pci_0000_00_03_6", "address": "0000:00:03.6", "product_id": "000c", "vendor_id": "1b36", "numa_node": null, "label": "label_1b36_000c", "dev_type": "type-PCI"}] {{(pid=98967) _report_hypervisor_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1136}} Jun 26 10:40:12.355875 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:12.544917 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:12.999605 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:40:13.001034 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:40:13.001034 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] VM Started (Lifecycle Event) Jun 26 10:40:13.008323 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Guest created on hypervisor {{(pid=98967) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 26 10:40:13.015599 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Instance spawned successfully. Jun 26 10:40:13.016189 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 26 10:40:13.072739 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-30b06554-4bb2-4ae1-9eca-239ecf90faa9 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:40:13.073079 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-30b06554-4bb2-4ae1-9eca-239ecf90faa9 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:40:13.511440 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:40:13.517269 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:40:13.537408 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Found default for hw_cdrom_bus of ide {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:40:13.537408 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Found default for hw_disk_bus of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:40:13.537408 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Found default for hw_input_bus of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:40:13.537408 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Found default for hw_pointer_model of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:40:13.537408 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Found default for hw_video_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:40:13.537408 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Found default for hw_vif_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:40:13.578417 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-30b06554-4bb2-4ae1-9eca-239ecf90faa9 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:40:13.909878 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:14.025030 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] During sync_power_state the instance has a pending task (spawning). Skip. Jun 26 10:40:14.025601 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Paused> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:40:14.025601 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] VM Paused (Lifecycle Event) Jun 26 10:40:14.043502 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Took 8.04 seconds to spawn the instance on the hypervisor. Jun 26 10:40:14.043502 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:40:14.133678 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-8f612fe5-1f24-436f-b801-7a510e1366e7 req-186e5129-79e2-4894-b205-3fcc786c8f4b service nova] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Received event network-vif-plugged-7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:14.133990 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-8f612fe5-1f24-436f-b801-7a510e1366e7 req-186e5129-79e2-4894-b205-3fcc786c8f4b service nova] Acquiring lock "ff80bcea-f14b-4814-98b8-012772daf17e-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:14.134236 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-8f612fe5-1f24-436f-b801-7a510e1366e7 req-186e5129-79e2-4894-b205-3fcc786c8f4b service nova] Lock "ff80bcea-f14b-4814-98b8-012772daf17e-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:14.135925 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-8f612fe5-1f24-436f-b801-7a510e1366e7 req-186e5129-79e2-4894-b205-3fcc786c8f4b service nova] Lock "ff80bcea-f14b-4814-98b8-012772daf17e-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:14.135925 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-8f612fe5-1f24-436f-b801-7a510e1366e7 req-186e5129-79e2-4894-b205-3fcc786c8f4b service nova] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] No waiting events found dispatching network-vif-plugged-7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:14.135925 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-8f612fe5-1f24-436f-b801-7a510e1366e7 req-186e5129-79e2-4894-b205-3fcc786c8f4b service nova] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Received unexpected event network-vif-plugged-7ee68f0a-8de8-4ddf-a87b-c3d0cca993dc for instance with vm_state active and task_state None. Jun 26 10:40:14.529476 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:40:14.531414 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:40:14.531572 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] VM Resumed (Lifecycle Event) Jun 26 10:40:14.553442 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Took 14.23 seconds to build instance. Jun 26 10:40:14.593621 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-30b06554-4bb2-4ae1-9eca-239ecf90faa9 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_source" :: held 3.355s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:14.597210 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 2.257s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:15.035389 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:40:15.040586 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:40:15.054897 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "ff80bcea-f14b-4814-98b8-012772daf17e" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 15.739s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:15.108785 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98967) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 26 10:40:15.108785 np0000003731 nova-compute[98967]: INFO nova.compute.claims [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Claim successful on node np0000003731 Jun 26 10:40:15.290244 np0000003731 nova-compute[98967]: INFO nova.scheduler.client.report [None req-30b06554-4bb2-4ae1-9eca-239ecf90faa9 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Deleted allocation for migration e32c4165-65b0-4a56-8723-54a78d880640 Jun 26 10:40:15.619808 np0000003731 nova-compute[98967]: INFO nova.compute.resource_tracker [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Updating resource usage from migration 66b6aa46-c062-432a-9043-282c83c1c1b8 Jun 26 10:40:15.800112 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-30b06554-4bb2-4ae1-9eca-239ecf90faa9 tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "c1043abd-b0c0-439e-b065-8bef627483cb" "released" by "nova.compute.manager.ComputeManager.confirm_resize..do_confirm_resize" :: held 7.984s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:16.880796 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:40:16.881287 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:40:16.886352 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-df796f49-3446-498a-a773-ab22003251b9 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:40:16.913315 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "edf92675-15b4-424f-85b5-80341e77b578" by "nova.compute.manager.ComputeManager.shelve_instance..do_shelve_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:16.913493 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "edf92675-15b4-424f-85b5-80341e77b578" acquired by "nova.compute.manager.ComputeManager.shelve_instance..do_shelve_instance" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:16.913637 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Shelving Jun 26 10:40:16.999307 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-773f5721-7493-461f-8121-b94d2d207ea5 req-fa4fac91-a95b-42c5-b57f-dbed038f1d81 service nova] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Received event network-changed-b747180c-b090-4936-90bc-0c6553817170 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:17.001676 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-773f5721-7493-461f-8121-b94d2d207ea5 req-fa4fac91-a95b-42c5-b57f-dbed038f1d81 service nova] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Refreshing instance network info cache due to event network-changed-b747180c-b090-4936-90bc-0c6553817170. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:40:17.001954 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-773f5721-7493-461f-8121-b94d2d207ea5 req-fa4fac91-a95b-42c5-b57f-dbed038f1d81 service nova] Acquiring lock "refresh_cache-f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:40:17.002225 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-773f5721-7493-461f-8121-b94d2d207ea5 req-fa4fac91-a95b-42c5-b57f-dbed038f1d81 service nova] Acquired lock "refresh_cache-f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:40:17.002467 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-773f5721-7493-461f-8121-b94d2d207ea5 req-fa4fac91-a95b-42c5-b57f-dbed038f1d81 service nova] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Refreshing network info cache for port b747180c-b090-4936-90bc-0c6553817170 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:40:17.383551 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:40:17.394053 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-df796f49-3446-498a-a773-ab22003251b9 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] instance snapshotting Jun 26 10:40:17.506646 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-773f5721-7493-461f-8121-b94d2d207ea5 req-fa4fac91-a95b-42c5-b57f-dbed038f1d81 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:17.521031 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-df796f49-3446-498a-a773-ab22003251b9 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Beginning live snapshot process Jun 26 10:40:17.548257 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:17.666554 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.00031238999986271665 future=) was cancelled during its delay period, skipping {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:17.666702 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:17.892643 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 3.299s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:17.893378 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: waited 5.538s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:17.894057 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Migrating Jun 26 10:40:17.894399 np0000003731 nova-compute[98967]: DEBUG nova.compute.rpcapi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98967) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 26 10:40:17.951799 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-773f5721-7493-461f-8121-b94d2d207ea5 req-fa4fac91-a95b-42c5-b57f-dbed038f1d81 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:17.960969 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:17.975920 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:18.004622 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:18.004622 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:18.030973 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:18.195573 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-773f5721-7493-461f-8121-b94d2d207ea5 req-fa4fac91-a95b-42c5-b57f-dbed038f1d81 service nova] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Updated VIF entry in instance network info cache for port b747180c-b090-4936-90bc-0c6553817170. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:40:18.196022 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-773f5721-7493-461f-8121-b94d2d207ea5 req-fa4fac91-a95b-42c5-b57f-dbed038f1d81 service nova] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Updating instance_info_cache with network_info: [{"id": "b747180c-b090-4936-90bc-0c6553817170", "address": "fa:16:3e:43:d8:28", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb747180c-b0", "ovs_interfaceid": "b747180c-b090-4936-90bc-0c6553817170", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:40:18.244613 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:18.282262 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:18.292931 np0000003731 nova-compute[98967]: DEBUG nova.utils [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Queued Task(fn=>, remaining_delay=14.999680719000025 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:18.295037 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=14.997585642000104 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:18.298763 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: edf92675-15b4-424f-85b5-80341e77b578] Instance destroyed successfully. Jun 26 10:40:18.299303 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lazy-loading 'numa_topology' on Instance uuid edf92675-15b4-424f-85b5-80341e77b578 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:18.309283 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=14.98338112700003 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:18.420682 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquiring lock "refresh_cache-3a56a898-691e-473e-a5c1-d618e861087b" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:40:18.421053 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquired lock "refresh_cache-3a56a898-691e-473e-a5c1-d618e861087b" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:40:18.421133 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:40:18.676855 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:18.686054 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:18.689923 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:18.697985 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-773f5721-7493-461f-8121-b94d2d207ea5 req-fa4fac91-a95b-42c5-b57f-dbed038f1d81 service nova] Releasing lock "refresh_cache-f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:40:18.712318 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:18.719222 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:18.840481 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:18.871676 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:18.912817 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:18.915657 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Applying migration context for instance 3a56a898-691e-473e-a5c1-d618e861087b as it has an incoming, in-progress migration 66b6aa46-c062-432a-9043-282c83c1c1b8. Migration status is pre-migrating {{(pid=98967) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1046}} Jun 26 10:40:18.918476 np0000003731 nova-compute[98967]: INFO nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Updating resource usage from migration 66b6aa46-c062-432a-9043-282c83c1c1b8 Jun 26 10:40:18.926840 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:18.938689 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Beginning cold snapshot process Jun 26 10:40:19.010645 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance 3a56a898-691e-473e-a5c1-d618e861087b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:40:19.010848 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Migration 66b6aa46-c062-432a-9043-282c83c1c1b8 is active on this compute host and has allocations in placement: {'resources': {'VCPU': 1, 'MEMORY_MB': 192, 'DISK_GB': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1745}} Jun 26 10:40:19.011317 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance edf92675-15b4-424f-85b5-80341e77b578 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:40:19.011613 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance 3dd6ac52-de12-47da-bc90-77d0fff44acf actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:40:19.012173 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance 212147b0-26de-42cd-b43d-057ec8d61c72 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:40:19.012327 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance 4b4a4a7e-d584-427e-91d2-7d9e710ea2a3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:40:19.012470 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance c1043abd-b0c0-439e-b065-8bef627483cb actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 256, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:40:19.012604 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance d26dc4db-d71c-43b9-811a-d39b111be119 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:40:19.012736 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:40:19.012857 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance 619d915a-12c9-424f-8c12-b2a3f94a4109 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:40:19.013141 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance 047061b2-340c-4cc9-899b-0744dad0081f actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:40:19.013141 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance 25b12be8-e92b-4705-b668-05cfecaf66b3 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:40:19.013325 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance c8aff61a-5f59-4f8c-8288-abd5a7853474 actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:40:19.013411 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance 0ae0d213-f58c-4ee5-844f-960b16a5a95b actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:40:19.013616 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance b53c3532-08c2-4c05-b5e5-c217d3ef4d9a actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:40:19.013778 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance ff80bcea-f14b-4814-98b8-012772daf17e actively managed on this compute host and has allocations in placement: {'resources': {'DISK_GB': 1, 'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:40:19.013987 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Instance ee4d14ad-8bd2-4b8b-9526-51abafe757f2 actively managed on this compute host and has allocations in placement: {'resources': {'MEMORY_MB': 192, 'VCPU': 1}}. {{(pid=98967) _remove_deleted_instances_allocations /opt/stack/nova/nova/compute/resource_tracker.py:1740}} Jun 26 10:40:19.014258 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Total usable vcpus: 16, total allocated vcpus: 17 {{(pid=98967) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1159}} Jun 26 10:40:19.015128 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Final resource view: name=np0000003731 phys_ram=64301MB used_ram=3904MB phys_disk=95GB used_disk=13GB total_vcpus=16 used_vcpus=17 pci_stats=[] stats={'failed_builds': '0', 'uptime': ' 10:40:12 up 29 min, 2 users, load average: 10.87, 7.51, 3.62\n', 'num_instances': '16', 'num_vm_active': '15', 'num_task_None': '13', 'num_os_type_None': '16', 'num_proj_49c2798faed447838b6c87f6d15cce66': '5', 'io_workload': '1', 'num_proj_58a58b94e5ec406182da9117e14aa789': '3', 'num_vm_rescued': '1', 'num_proj_ed3cec81bee74bf3913ab4fcab11a000': '1', 'num_proj_ea834a26efe148649425d3e02d974ef4': '3', 'num_task_resize_prep': '1', 'num_proj_13f2d75c17e64be5a0a5a2de4aaca2e7': '1', 'num_task_shelving': '1', 'num_proj_39600b204ad64a6db28676693c86dd70': '1', 'num_proj_40a4e84471c94128b1ac4dd00ca7177b': '1', 'num_proj_4d10b4c2e162455786d5aa40d72a31c7': '1', 'num_task_image_pending_upload': '1'} {{(pid=98967) _report_final_resource_view /opt/stack/nova/nova/compute/resource_tracker.py:1168}} Jun 26 10:40:19.046402 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-df796f49-3446-498a-a773-ab22003251b9 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff80bcea-f14b-4814-98b8-012772daf17e/disk --force-share --output=json -f qcow2 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:19.087415 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-cbbef0ff-35eb-4d35-af6f-1d948152569b req-c672061d-0912-42ba-9ecc-9ed2fc8e447c service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Received event network-changed-061a7108-6f47-4def-b12d-38eb13d382f6 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:19.088024 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-cbbef0ff-35eb-4d35-af6f-1d948152569b req-c672061d-0912-42ba-9ecc-9ed2fc8e447c service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Refreshing instance network info cache due to event network-changed-061a7108-6f47-4def-b12d-38eb13d382f6. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:40:19.088877 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-cbbef0ff-35eb-4d35-af6f-1d948152569b req-c672061d-0912-42ba-9ecc-9ed2fc8e447c service nova] Acquiring lock "refresh_cache-c1043abd-b0c0-439e-b065-8bef627483cb" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:40:19.088877 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-cbbef0ff-35eb-4d35-af6f-1d948152569b req-c672061d-0912-42ba-9ecc-9ed2fc8e447c service nova] Acquired lock "refresh_cache-c1043abd-b0c0-439e-b065-8bef627483cb" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:40:19.088877 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-cbbef0ff-35eb-4d35-af6f-1d948152569b req-c672061d-0912-42ba-9ecc-9ed2fc8e447c service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Refreshing network info cache for port 061a7108-6f47-4def-b12d-38eb13d382f6 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:40:19.157763 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-df796f49-3446-498a-a773-ab22003251b9 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff80bcea-f14b-4814-98b8-012772daf17e/disk --force-share --output=json -f qcow2" returned: 0 in 0.112s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:19.157996 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-df796f49-3446-498a-a773-ab22003251b9 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff80bcea-f14b-4814-98b8-012772daf17e/disk --force-share --output=json -f qcow2 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:19.278263 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-df796f49-3446-498a-a773-ab22003251b9 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/ff80bcea-f14b-4814-98b8-012772daf17e/disk --force-share --output=json -f qcow2" returned: 0 in 0.120s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:19.279339 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-df796f49-3446-498a-a773-ab22003251b9 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:40:19.283746 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-df796f49-3446-498a-a773-ab22003251b9 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:40:19.284180 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-df796f49-3446-498a-a773-ab22003251b9 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:19.388464 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-df796f49-3446-498a-a773-ab22003251b9 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.104s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:19.389180 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-df796f49-3446-498a-a773-ab22003251b9 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqf26qbwg/27cde296e72b47439c99590fcc8919b1.delta 1073741824 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:19.468755 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:19.477584 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-df796f49-3446-498a-a773-ab22003251b9 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe,backing_fmt=raw /opt/stack/data/nova/instances/snapshots/tmpqf26qbwg/27cde296e72b47439c99590fcc8919b1.delta 1073741824" returned: 0 in 0.088s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:19.478164 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-df796f49-3446-498a-a773-ab22003251b9 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Quiescing instance not available: QEMU guest agent is not enabled. Jun 26 10:40:19.593845 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-cbbef0ff-35eb-4d35-af6f-1d948152569b req-c672061d-0912-42ba-9ecc-9ed2fc8e447c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:19.690589 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Updating instance_info_cache with network_info: [{"id": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "address": "fa:16:3e:9c:69:06", "network": {"id": "745fd3f4-1b5b-4135-add5-62d583152edb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1747333964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13f2d75c17e64be5a0a5a2de4aaca2e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f36cb-f5", "ovs_interfaceid": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:40:19.791597 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-df796f49-3446-498a-a773-ab22003251b9 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] COPY block job progress, current cursor: 1 final cursor: 1 {{(pid=98967) is_job_complete /opt/stack/nova/nova/virt/libvirt/guest.py:866}} Jun 26 10:40:19.794341 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-df796f49-3446-498a-a773-ab22003251b9 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Skipping quiescing instance: QEMU guest agent is not enabled. Jun 26 10:40:19.865436 np0000003731 nova-compute[98967]: DEBUG nova.privsep.utils [None req-df796f49-3446-498a-a773-ab22003251b9 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98967) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 26 10:40:19.866105 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-df796f49-3446-498a-a773-ab22003251b9 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqf26qbwg/27cde296e72b47439c99590fcc8919b1.delta /opt/stack/data/nova/instances/snapshots/tmpqf26qbwg/27cde296e72b47439c99590fcc8919b1 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:20.063384 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-cbbef0ff-35eb-4d35-af6f-1d948152569b req-c672061d-0912-42ba-9ecc-9ed2fc8e447c service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:20.158925 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-df796f49-3446-498a-a773-ab22003251b9 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/snapshots/tmpqf26qbwg/27cde296e72b47439c99590fcc8919b1.delta /opt/stack/data/nova/instances/snapshots/tmpqf26qbwg/27cde296e72b47439c99590fcc8919b1" returned: 0 in 0.293s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:20.159660 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-df796f49-3446-498a-a773-ab22003251b9 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Snapshot extracted, beginning image upload Jun 26 10:40:20.200415 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Releasing lock "refresh_cache-3a56a898-691e-473e-a5c1-d618e861087b" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:40:20.371884 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-cbbef0ff-35eb-4d35-af6f-1d948152569b req-c672061d-0912-42ba-9ecc-9ed2fc8e447c service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Updated VIF entry in instance network info cache for port 061a7108-6f47-4def-b12d-38eb13d382f6. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:40:20.372137 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-cbbef0ff-35eb-4d35-af6f-1d948152569b req-c672061d-0912-42ba-9ecc-9ed2fc8e447c service nova] [instance: c1043abd-b0c0-439e-b065-8bef627483cb] Updating instance_info_cache with network_info: [{"id": "061a7108-6f47-4def-b12d-38eb13d382f6", "address": "fa:16:3e:48:bc:a4", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.4", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.216", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap061a7108-6f", "ovs_interfaceid": "061a7108-6f47-4def-b12d-38eb13d382f6", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:40:20.373643 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:40:20.384961 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:40:20.469039 np0000003731 nova-compute[98967]: DEBUG nova.privsep.utils [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98967) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 26 10:40:20.469039 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578/disk /opt/stack/data/nova/instances/snapshots/tmpsox_g_zn/7bc8da92be574297857824c2203a8551 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:20.876601 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-cbbef0ff-35eb-4d35-af6f-1d948152569b req-c672061d-0912-42ba-9ecc-9ed2fc8e447c service nova] Releasing lock "refresh_cache-c1043abd-b0c0-439e-b065-8bef627483cb" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:40:20.876919 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-cbbef0ff-35eb-4d35-af6f-1d948152569b req-c672061d-0912-42ba-9ecc-9ed2fc8e447c service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Received event network-vif-unplugged-603c0b2c-d13b-48d6-a1a0-77c17c62c23e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:20.877260 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-cbbef0ff-35eb-4d35-af6f-1d948152569b req-c672061d-0912-42ba-9ecc-9ed2fc8e447c service nova] Acquiring lock "edf92675-15b4-424f-85b5-80341e77b578-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:20.877457 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-cbbef0ff-35eb-4d35-af6f-1d948152569b req-c672061d-0912-42ba-9ecc-9ed2fc8e447c service nova] Lock "edf92675-15b4-424f-85b5-80341e77b578-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:20.877618 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-cbbef0ff-35eb-4d35-af6f-1d948152569b req-c672061d-0912-42ba-9ecc-9ed2fc8e447c service nova] Lock "edf92675-15b4-424f-85b5-80341e77b578-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:20.877831 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-cbbef0ff-35eb-4d35-af6f-1d948152569b req-c672061d-0912-42ba-9ecc-9ed2fc8e447c service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] No waiting events found dispatching network-vif-unplugged-603c0b2c-d13b-48d6-a1a0-77c17c62c23e {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:20.878891 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:40:20.884517 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-cbbef0ff-35eb-4d35-af6f-1d948152569b req-c672061d-0912-42ba-9ecc-9ed2fc8e447c service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Received unexpected event network-vif-unplugged-603c0b2c-d13b-48d6-a1a0-77c17c62c23e for instance with vm_state active and task_state shelving_image_pending_upload. Jun 26 10:40:20.886817 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-cbbef0ff-35eb-4d35-af6f-1d948152569b req-c672061d-0912-42ba-9ecc-9ed2fc8e447c service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Received event network-vif-unplugged-603c0b2c-d13b-48d6-a1a0-77c17c62c23e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:20.887019 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-cbbef0ff-35eb-4d35-af6f-1d948152569b req-c672061d-0912-42ba-9ecc-9ed2fc8e447c service nova] Acquiring lock "edf92675-15b4-424f-85b5-80341e77b578-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:20.887238 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-cbbef0ff-35eb-4d35-af6f-1d948152569b req-c672061d-0912-42ba-9ecc-9ed2fc8e447c service nova] Lock "edf92675-15b4-424f-85b5-80341e77b578-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:20.887395 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-cbbef0ff-35eb-4d35-af6f-1d948152569b req-c672061d-0912-42ba-9ecc-9ed2fc8e447c service nova] Lock "edf92675-15b4-424f-85b5-80341e77b578-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:20.887796 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-cbbef0ff-35eb-4d35-af6f-1d948152569b req-c672061d-0912-42ba-9ecc-9ed2fc8e447c service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] No waiting events found dispatching network-vif-unplugged-603c0b2c-d13b-48d6-a1a0-77c17c62c23e {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:20.887854 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-cbbef0ff-35eb-4d35-af6f-1d948152569b req-c672061d-0912-42ba-9ecc-9ed2fc8e447c service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Received unexpected event network-vif-unplugged-603c0b2c-d13b-48d6-a1a0-77c17c62c23e for instance with vm_state active and task_state shelving_image_pending_upload. Jun 26 10:40:21.392033 np0000003731 nova-compute[98967]: DEBUG nova.compute.resource_tracker [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Compute_service record updated for np0000003731:np0000003731 {{(pid=98967) _update_available_resource /opt/stack/nova/nova/compute/resource_tracker.py:1097}} Jun 26 10:40:21.392033 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker._update_available_resource" :: held 3.497s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:21.392033 np0000003731 nova-compute[98967]: DEBUG oslo.service.backend._threading.loopingcall [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 0.99 seconds {{(pid=98967) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 26 10:40:21.601194 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "qemu-img convert -t none -O qcow2 -f qcow2 /opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578/disk /opt/stack/data/nova/instances/snapshots/tmpsox_g_zn/7bc8da92be574297857824c2203a8551" returned: 0 in 1.134s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:21.604021 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Snapshot extracted, beginning image upload Jun 26 10:40:21.730310 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Starting migrate_disk_and_power_off {{(pid=98967) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12621}} Jun 26 10:40:21.787386 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:21.794055 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:21.820217 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:21.837393 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:21.875340 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:21.875992 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:22.077228 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-88d0a021-a8d7-4bfe-a45c-bd36afd6d706 req-488c2bf2-1331-4566-a823-3f158115bd10 service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Received event network-vif-unplugged-fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:22.077482 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-88d0a021-a8d7-4bfe-a45c-bd36afd6d706 req-488c2bf2-1331-4566-a823-3f158115bd10 service nova] Acquiring lock "3a56a898-691e-473e-a5c1-d618e861087b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:22.080437 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-88d0a021-a8d7-4bfe-a45c-bd36afd6d706 req-488c2bf2-1331-4566-a823-3f158115bd10 service nova] Lock "3a56a898-691e-473e-a5c1-d618e861087b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:22.080739 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-88d0a021-a8d7-4bfe-a45c-bd36afd6d706 req-488c2bf2-1331-4566-a823-3f158115bd10 service nova] Lock "3a56a898-691e-473e-a5c1-d618e861087b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.003s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:22.080928 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-88d0a021-a8d7-4bfe-a45c-bd36afd6d706 req-488c2bf2-1331-4566-a823-3f158115bd10 service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] No waiting events found dispatching network-vif-unplugged-fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:22.081169 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-88d0a021-a8d7-4bfe-a45c-bd36afd6d706 req-488c2bf2-1331-4566-a823-3f158115bd10 service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Received unexpected event network-vif-unplugged-fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df for instance with vm_state active and task_state resize_migrating. Jun 26 10:40:22.139439 np0000003731 nova-compute[98967]: DEBUG nova.utils [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Queued Task(fn=>, remaining_delay=14.99959948899982 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:22.147299 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Instance destroyed successfully. Jun 26 10:40:22.150268 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-189933630',display_name='tempest-ServerActionsTestOtherB-server-189933630',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-serveractionstestotherb-server-189933630',id=19,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDv+GLIZEgqCpG9Ar7Sy1trgWnL3YEyqFHnBU/WG9g4CSqyvLBbCulNghiyJn3KpB/3bSNsGv+SgxNXmmFNVCZyLb+bs7KEXcLVodWAftMPleXJm0MjBQWdyVYaPKr8FFQ==',key_name='tempest-keypair-1436363432',keypairs=,launch_index=0,launched_at=2026-06-26T10:39:14Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='13f2d75c17e64be5a0a5a2de4aaca2e7',ramdisk_id='',reservation_id='r-y898iga0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-576427951',owner_user_name='tempest-ServerActionsTestOtherB-576427951-project-member'},tags=,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:40:12Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d2ca60f7c4f4cb5a413138ae1f040a7',uuid=3a56a898-691e-473e-a5c1-d618e861087b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "address": "fa:16:3e:9c:69:06", "network": {"id": "745fd3f4-1b5b-4135-add5-62d583152edb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1747333964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1747333964-network", "vif_mac": "fa:16:3e:9c:69:06"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13f2d75c17e64be5a0a5a2de4aaca2e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f36cb-f5", "ovs_interfaceid": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 26 10:40:22.150268 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Converting VIF {"id": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "address": "fa:16:3e:9c:69:06", "network": {"id": "745fd3f4-1b5b-4135-add5-62d583152edb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1747333964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1747333964-network", "vif_mac": "fa:16:3e:9c:69:06"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13f2d75c17e64be5a0a5a2de4aaca2e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f36cb-f5", "ovs_interfaceid": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:40:22.153525 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:69:06,bridge_name='br-int',has_traffic_filtering=True,id=fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df,network=Network(745fd3f4-1b5b-4135-add5-62d583152edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd2f36cb-f5') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:40:22.153525 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:69:06,bridge_name='br-int',has_traffic_filtering=True,id=fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df,network=Network(745fd3f4-1b5b-4135-add5-62d583152edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd2f36cb-f5') {{(pid=98967) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 26 10:40:22.157973 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:22.157973 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd2f36cb-f5, bridge=br-int, if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:22.160191 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:22.161721 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:22.171738 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:22.173979 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:22.174243 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=4bb4243e-5d6a-4e73-9b37-05feee3a99cc) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:22.177152 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:22.193500 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:22.198485 np0000003731 nova-compute[98967]: INFO os_vif [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:69:06,bridge_name='br-int',has_traffic_filtering=True,id=fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df,network=Network(745fd3f4-1b5b-4135-add5-62d583152edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd2f36cb-f5') Jun 26 10:40:22.200910 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] calling os-brick to detach iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 26 10:40:22.200910 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, None), 'kwargs': {'force': False}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:40:22.200910 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:40:22.204126 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.003s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:40:22.204922 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 10:40:22.205359 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', 0)] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 10:40:22.278490 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:22.278490 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:22.278490 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:22.278490 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:22.278490 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:22.278490 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:22.278490 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:22.278490 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:22.278490 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:22.278490 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:22.278490 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:22.278490 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:22.278490 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:22.278490 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:22.278490 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:22.278490 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:22.278490 np0000003731 nova-compute[98967]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:22.278490 np0000003731 nova-compute[98967]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:22.278490 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:40:22.279279 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:22.279279 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:22.279279 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:22.279279 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:22.279279 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:22.279279 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:22.279279 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:22.279279 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:22.279279 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:22.279279 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:22.279279 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:22.279279 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:22.279279 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:22.279279 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:22.279279 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:22.279279 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:22.279279 np0000003731 nova-compute[98967]: tcp: [36] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:22.279279 np0000003731 nova-compute[98967]: tcp: [37] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:22.279279 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:40:22.279992 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '2'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', '36'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', '37')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 10:40:22.279992 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', '37')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:40:22.281722 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', '36')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:40:22.283630 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Resulting device map defaultdict(. at 0x75f0702fc5e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24'): ({'sds'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24'): ({'sdr'}, set())}) {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 10:40:22.284836 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Removing multipathed devices sdr, sds {{(pid=98967) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 10:40:22.284836 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Flush multipath device 330000000e9c36c73 {{(pid=98967) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 26 10:40:22.320315 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Remove SCSI device /dev/sdr with /sys/block/sdr/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:40:22.376624 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Remove SCSI device /dev/sds with /sys/block/sds/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:40:22.385842 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._check_instance_build_time {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:40:22.386441 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._sync_scheduler_instance_info {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:40:22.387276 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._poll_rebooting_instances {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:40:22.388578 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._poll_rescued_instances {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:40:22.388578 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._poll_unconfirmed_resizes {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:40:22.388578 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._instance_usage_audit {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:40:22.388930 np0000003731 nova-compute[98967]: DEBUG oslo_service.periodic_task [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Running periodic task ComputeManager._poll_volume_usage {{(pid=98967) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jun 26 10:40:22.389371 np0000003731 nova-compute[98967]: DEBUG oslo.service.backend._threading.loopingcall [None req-768990df-bd1d-4508-84a7-8ff51015a24f None None] Dynamic interval looping call 'nova.service.Service.periodic_tasks' sleeping for 46.72 seconds {{(pid=98967) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 26 10:40:22.400313 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:22.436497 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Checking to see if SCSI volumes sdr, sds have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 10:40:22.437291 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] SCSI volumes sdr, sds have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 10:40:22.441904 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Checking to see if device paths {'sdr', 'sds'} are still under multipathd monitoring {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 10:40:22.459335 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Device paths {'sdr', 'sds'} have been removed from multipathd monitoring. {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 10:40:22.459335 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24')] {{(pid=98967) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 10:40:22.478831 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:22.538361 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Rebuilding instance Jun 26 10:40:22.544810 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 37, target: iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24, portal: 192.168.40.100,3260] Jun 26 10:40:22.544810 np0000003731 nova-compute[98967]: Logout of [sid: 37, target: iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24, portal: 192.168.40.100,3260] successful. Jun 26 10:40:22.544810 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:22.553738 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:22.583321 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:22.610326 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:22.670766 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 36, target: iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24, portal: 192.168.50.100,3260] Jun 26 10:40:22.670766 np0000003731 nova-compute[98967]: Logout of [sid: 36, target: iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24, portal: 192.168.50.100,3260] successful. Jun 26 10:40:22.670766 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:22.706957 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:22.707904 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.504s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:40:22.708174 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] <== disconnect_volume: return (507ms) None {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:40:22.708514 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Disconnected iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 26 10:40:22.713078 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:22.818928 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk --force-share --output=json" returned: 0 in 0.105s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:22.818928 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:22.846498 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:40:22.952378 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk --force-share --output=json" returned: 0 in 0.134s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:22.956888 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] skipping disk /dev/dm-14 (vdb) as it is a volume {{(pid=98967) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 26 10:40:22.956888 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b_resize/disk /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:23.093794 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] CMD "cp -r /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b_resize/disk /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk" returned: 0 in 0.138s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:23.094823 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b_resize/disk.config /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk.config {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:23.143477 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] CMD "cp -r /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b_resize/disk.config /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk.config" returned: 0 in 0.048s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:23.143477 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b_resize/disk.info /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk.info {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:23.194639 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] CMD "cp -r /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b_resize/disk.info /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk.info" returned: 0 in 0.051s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:23.456954 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-df796f49-3446-498a-a773-ab22003251b9 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Snapshot image upload complete Jun 26 10:40:23.457558 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-df796f49-3446-498a-a773-ab22003251b9 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: ff80bcea-f14b-4814-98b8-012772daf17e] Took 6.06 seconds to snapshot the instance on the hypervisor. Jun 26 10:40:23.932877 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:23.952615 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:23.961494 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:23.974080 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:24.015510 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:24.212085 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-36f59952-5de2-4009-aa2c-395025243e5d req-c7d717b2-e470-47fc-bacb-472aa255504f service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Received event network-vif-unplugged-fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:24.212085 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-36f59952-5de2-4009-aa2c-395025243e5d req-c7d717b2-e470-47fc-bacb-472aa255504f service nova] Acquiring lock "3a56a898-691e-473e-a5c1-d618e861087b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:24.212085 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-36f59952-5de2-4009-aa2c-395025243e5d req-c7d717b2-e470-47fc-bacb-472aa255504f service nova] Lock "3a56a898-691e-473e-a5c1-d618e861087b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:24.213521 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-36f59952-5de2-4009-aa2c-395025243e5d req-c7d717b2-e470-47fc-bacb-472aa255504f service nova] Lock "3a56a898-691e-473e-a5c1-d618e861087b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:24.214595 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-36f59952-5de2-4009-aa2c-395025243e5d req-c7d717b2-e470-47fc-bacb-472aa255504f service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] No waiting events found dispatching network-vif-unplugged-fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:24.214595 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-36f59952-5de2-4009-aa2c-395025243e5d req-c7d717b2-e470-47fc-bacb-472aa255504f service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Received unexpected event network-vif-unplugged-fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df for instance with vm_state active and task_state resize_migrating. Jun 26 10:40:24.215070 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-36f59952-5de2-4009-aa2c-395025243e5d req-c7d717b2-e470-47fc-bacb-472aa255504f service nova] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Received event network-vif-unplugged-288e6be4-7ae8-4847-ad8e-a0b0b95afa6d {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:24.215070 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-36f59952-5de2-4009-aa2c-395025243e5d req-c7d717b2-e470-47fc-bacb-472aa255504f service nova] Acquiring lock "3dd6ac52-de12-47da-bc90-77d0fff44acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:24.215720 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-36f59952-5de2-4009-aa2c-395025243e5d req-c7d717b2-e470-47fc-bacb-472aa255504f service nova] Lock "3dd6ac52-de12-47da-bc90-77d0fff44acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:24.215720 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-36f59952-5de2-4009-aa2c-395025243e5d req-c7d717b2-e470-47fc-bacb-472aa255504f service nova] Lock "3dd6ac52-de12-47da-bc90-77d0fff44acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:24.215720 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-36f59952-5de2-4009-aa2c-395025243e5d req-c7d717b2-e470-47fc-bacb-472aa255504f service nova] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] No waiting events found dispatching network-vif-unplugged-288e6be4-7ae8-4847-ad8e-a0b0b95afa6d {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:24.215720 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-36f59952-5de2-4009-aa2c-395025243e5d req-c7d717b2-e470-47fc-bacb-472aa255504f service nova] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Received unexpected event network-vif-unplugged-288e6be4-7ae8-4847-ad8e-a0b0b95afa6d for instance with vm_state active and task_state rebuilding. Jun 26 10:40:24.271108 np0000003731 nova-compute[98967]: DEBUG nova.utils [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Queued Task(fn=>, remaining_delay=14.999579441999913 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:24.279136 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Instance destroyed successfully. Jun 26 10:40:24.296085 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Instance destroyed successfully. Jun 26 10:40:24.297999 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-24050431',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-serveractionsv293testjson-server-739986196',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpC408hAS7ZHCLcxOORErGa34r6kFwvPfr3Lp/mseMBy2poBV1dMkTaNTtK74/pNLf0Wh6LpCI1nkrL/Xs5OehD5/80bs1kvQaAe6W4GP47k+Sfo1MyP9GisRKDNYuUyg==',key_name='tempest-keypair-400928869',keypairs=,launch_index=0,launched_at=2026-06-26T10:39:42Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='40a4e84471c94128b1ac4dd00ca7177b',ramdisk_id='',reservation_id='r-c2y3fxk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='652e47dc-dbeb-4044-a4a6-a03fd1347421',image_container_format='bare',image_disk_format='qcow2',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1674673586',owner_user_name='tempest-ServerActionsV293TestJSON-1674673586-project-member'},tags=,task_state='rebuilding',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:40:21Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11ad63f2d09c4e7dac51c03de3a31f4a',uuid=3dd6ac52-de12-47da-bc90-77d0fff44acf,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "address": "fa:16:3e:41:2f:75", "network": {"id": "66d12b1b-32f2-4152-b44c-13e5284b49f9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-186021134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a4e84471c94128b1ac4dd00ca7177b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap288e6be4-7a", "ovs_interfaceid": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 26 10:40:24.298300 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Converting VIF {"id": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "address": "fa:16:3e:41:2f:75", "network": {"id": "66d12b1b-32f2-4152-b44c-13e5284b49f9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-186021134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a4e84471c94128b1ac4dd00ca7177b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap288e6be4-7a", "ovs_interfaceid": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:40:24.299363 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:2f:75,bridge_name='br-int',has_traffic_filtering=True,id=288e6be4-7ae8-4847-ad8e-a0b0b95afa6d,network=Network(66d12b1b-32f2-4152-b44c-13e5284b49f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap288e6be4-7a') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:40:24.299728 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:2f:75,bridge_name='br-int',has_traffic_filtering=True,id=288e6be4-7ae8-4847-ad8e-a0b0b95afa6d,network=Network(66d12b1b-32f2-4152-b44c-13e5284b49f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap288e6be4-7a') {{(pid=98967) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 26 10:40:24.307036 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:24.307036 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap288e6be4-7a, bridge=br-int, if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:24.311883 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:24.312044 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:24.324820 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:24.330530 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:24.330530 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=13c5dcd5-f247-4ffe-a90d-b175ea904d43) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:24.332578 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:24.333948 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:24.345037 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:24.349132 np0000003731 nova-compute[98967]: INFO os_vif [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:2f:75,bridge_name='br-int',has_traffic_filtering=True,id=288e6be4-7ae8-4847-ad8e-a0b0b95afa6d,network=Network(66d12b1b-32f2-4152-b44c-13e5284b49f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap288e6be4-7a') Jun 26 10:40:24.358548 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] calling os-brick to detach iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 26 10:40:24.359860 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0838d3e5-41a4-4e26-b090-b276de7370ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:40:24.360094 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:40:24.362166 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:40:24.362542 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0838d3e5-41a4-4e26-b090-b276de7370ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 10:40:24.362784 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', 0)] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 10:40:24.431850 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:24.432320 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: tcp: [32] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: tcp: [33] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:24.440871 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:40:24.442140 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '2'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', '32'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', '33'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2', '35')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 10:40:24.442140 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', '32')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:40:24.442848 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', '33')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:40:24.450446 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Resulting device map defaultdict(. at 0x75f05040dc60>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee'): ({'sdn'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee'): ({'sdo'}, set())}) {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 10:40:24.450446 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Removing multipathed devices sdn, sdo {{(pid=98967) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 10:40:24.450446 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Flush multipath device 3300000003cd6755d {{(pid=98967) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 26 10:40:24.526174 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Remove SCSI device /dev/sdn with /sys/block/sdn/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:40:24.582790 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Port fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df binding to destination host np0000003731 is already ACTIVE {{(pid=98967) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}} Jun 26 10:40:24.590752 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Remove SCSI device /dev/sdo with /sys/block/sdo/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:40:24.643415 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Checking to see if SCSI volumes sdn, sdo have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 10:40:24.643415 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] SCSI volumes sdn, sdo have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 10:40:24.646916 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Checking to see if device paths {'sdn', 'sdo'} are still under multipathd monitoring {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 10:40:24.673408 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Device paths {'sdn', 'sdo'} have been removed from multipathd monitoring. {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 10:40:24.673408 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee')] {{(pid=98967) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 10:40:24.693913 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:24.763671 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 32, target: iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee, portal: 192.168.40.100,3260] Jun 26 10:40:24.763671 np0000003731 nova-compute[98967]: Logout of [sid: 32, target: iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee, portal: 192.168.40.100,3260] successful. Jun 26 10:40:24.763671 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:24.791476 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:24.816481 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:24.880806 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 33, target: iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee, portal: 192.168.50.100,3260] Jun 26 10:40:24.880806 np0000003731 nova-compute[98967]: Logout of [sid: 33, target: iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee, portal: 192.168.50.100,3260] successful. Jun 26 10:40:24.880806 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:24.916247 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:24.916247 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.555s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:40:24.917624 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] <== disconnect_volume: return (556ms) None {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:40:24.917624 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Disconnected iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 26 10:40:24.918579 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Deleting instance files /opt/stack/data/nova/instances/3dd6ac52-de12-47da-bc90-77d0fff44acf_del Jun 26 10:40:24.919943 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Deletion of /opt/stack/data/nova/instances/3dd6ac52-de12-47da-bc90-77d0fff44acf_del complete Jun 26 10:40:25.376847 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Snapshot image upload complete Jun 26 10:40:25.376847 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:40:25.569890 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] During detach_volume, instance disappeared.: nova.exception.InstanceNotFound: Instance 3dd6ac52-de12-47da-bc90-77d0fff44acf could not be found. Jun 26 10:40:25.571818 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] calling os-brick to detach iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 26 10:40:25.572409 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0838d3e5-41a4-4e26-b090-b276de7370ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, None), 'kwargs': {'force': False}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:40:25.572794 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:40:25.573346 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:40:25.574246 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0838d3e5-41a4-4e26-b090-b276de7370ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-10'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 10:40:25.574246 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', 0)] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 10:40:25.594338 np0000003731 nova-compute[98967]: DEBUG nova.compute.rpcapi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98967) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '2'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2', '35')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee, 0): [] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] No session or node found for (ip, iqn)=('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee') {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}} Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee, 0): [] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] No session or node found for (ip, iqn)=('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee') {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:886}} Jun 26 10:40:25.622171 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Resulting device map defaultdict(. at 0x75f05040d080>, {}) {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 10:40:25.625594 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Disconnecting from: [] {{(pid=98967) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 10:40:25.627951 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquiring lock "3a56a898-691e-473e-a5c1-d618e861087b-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:25.630064 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.055s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:40:25.630513 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "3a56a898-691e-473e-a5c1-d618e861087b-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.002s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:25.630743 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] <== disconnect_volume: return (57ms) None {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:40:25.630954 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "3a56a898-691e-473e-a5c1-d618e861087b-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:25.631948 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Disconnected iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 26 10:40:25.886825 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Shelve offloading Jun 26 10:40:26.288230 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b990dcaa-32c5-4374-90df-303db1302673 req-e29e622d-6287-4767-968c-d5211e1979ee service nova] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Received event network-vif-unplugged-288e6be4-7ae8-4847-ad8e-a0b0b95afa6d {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:26.288371 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b990dcaa-32c5-4374-90df-303db1302673 req-e29e622d-6287-4767-968c-d5211e1979ee service nova] Acquiring lock "3dd6ac52-de12-47da-bc90-77d0fff44acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:26.288638 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b990dcaa-32c5-4374-90df-303db1302673 req-e29e622d-6287-4767-968c-d5211e1979ee service nova] Lock "3dd6ac52-de12-47da-bc90-77d0fff44acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:26.288764 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b990dcaa-32c5-4374-90df-303db1302673 req-e29e622d-6287-4767-968c-d5211e1979ee service nova] Lock "3dd6ac52-de12-47da-bc90-77d0fff44acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:26.289230 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b990dcaa-32c5-4374-90df-303db1302673 req-e29e622d-6287-4767-968c-d5211e1979ee service nova] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] No waiting events found dispatching network-vif-unplugged-288e6be4-7ae8-4847-ad8e-a0b0b95afa6d {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:26.289412 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-b990dcaa-32c5-4374-90df-303db1302673 req-e29e622d-6287-4767-968c-d5211e1979ee service nova] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Received unexpected event network-vif-unplugged-288e6be4-7ae8-4847-ad8e-a0b0b95afa6d for instance with vm_state active and task_state rebuilding. Jun 26 10:40:26.396227 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: edf92675-15b4-424f-85b5-80341e77b578] Instance destroyed successfully. Jun 26 10:40:26.396816 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:40:26.399077 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "refresh_cache-edf92675-15b4-424f-85b5-80341e77b578" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:40:26.399077 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquired lock "refresh_cache-edf92675-15b4-424f-85b5-80341e77b578" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:40:26.399077 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:40:26.464180 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "7edf2e67-5bc5-420a-8674-997ea5a30152" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:26.464718 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "7edf2e67-5bc5-420a-8674-997ea5a30152" acquired by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:26.633506 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:26.765877 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquiring lock "refresh_cache-3a56a898-691e-473e-a5c1-d618e861087b" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:40:26.766872 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquired lock "refresh_cache-3a56a898-691e-473e-a5c1-d618e861087b" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:40:26.767776 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:40:26.865533 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Preparing to wait for external event volume-reimaged-0838d3e5-41a4-4e26-b090-b276de7370ee {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:40:26.865695 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Acquiring lock "3dd6ac52-de12-47da-bc90-77d0fff44acf-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:26.865811 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lock "3dd6ac52-de12-47da-bc90-77d0fff44acf-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:26.865932 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lock "3dd6ac52-de12-47da-bc90-77d0fff44acf-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:26.903121 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:26.967314 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Starting instance... {{(pid=98967) _do_build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2605}} Jun 26 10:40:27.236797 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Acquiring lock "interface-619d915a-12c9-424f-8c12-b2a3f94a4109-None" by "nova.compute.manager.ComputeManager.attach_interface..do_attach_interface" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:27.236877 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lock "interface-619d915a-12c9-424f-8c12-b2a3f94a4109-None" acquired by "nova.compute.manager.ComputeManager.attach_interface..do_attach_interface" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:27.237304 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lazy-loading 'flavor' on Instance uuid 619d915a-12c9-424f-8c12-b2a3f94a4109 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:27.270086 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:27.379265 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:27.547415 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:27.553787 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:27.553787 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98967) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 26 10:40:27.553787 np0000003731 nova-compute[98967]: INFO nova.compute.claims [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Claim successful on node np0000003731 Jun 26 10:40:27.554257 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:27.603336 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Updating instance_info_cache with network_info: [{"id": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "address": "fa:16:3e:97:32:1f", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap603c0b2c-d1", "ovs_interfaceid": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:40:27.745464 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:27.842074 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:27.945129 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lazy-loading 'pci_requests' on Instance uuid 619d915a-12c9-424f-8c12-b2a3f94a4109 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:28.044249 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Updating instance_info_cache with network_info: [{"id": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "address": "fa:16:3e:9c:69:06", "network": {"id": "745fd3f4-1b5b-4135-add5-62d583152edb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1747333964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13f2d75c17e64be5a0a5a2de4aaca2e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f36cb-f5", "ovs_interfaceid": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:40:28.103680 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Releasing lock "refresh_cache-edf92675-15b4-424f-85b5-80341e77b578" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:40:28.103978 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:28.104246 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:28.450816 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Object Instance<619d915a-12c9-424f-8c12-b2a3f94a4109> lazy-loaded attributes: flavor,pci_requests {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:40:28.450975 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] allocate_for_instance() {{(pid=98967) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 26 10:40:28.451280 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:28.451530 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:28.546856 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Releasing lock "refresh_cache-3a56a898-691e-473e-a5c1-d618e861087b" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:40:28.574035 np0000003731 nova-compute[98967]: DEBUG nova.policy [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '2182fde17d0f447c971e388b65911648', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d10b4c2e162455786d5aa40d72a31c7', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98967) authorize /opt/stack/nova/nova/policy.py:192}} Jun 26 10:40:28.834211 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: edf92675-15b4-424f-85b5-80341e77b578] Instance destroyed successfully. Jun 26 10:40:28.835134 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lazy-loading 'resources' on Instance uuid edf92675-15b4-424f-85b5-80341e77b578 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:28.890190 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-dc6f7529-03e6-4733-894c-754b2030cc14 req-ccf40ebd-56a0-4446-9d99-fad9c4d7f2bb service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Received event network-changed-603c0b2c-d13b-48d6-a1a0-77c17c62c23e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:28.890347 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-dc6f7529-03e6-4733-894c-754b2030cc14 req-ccf40ebd-56a0-4446-9d99-fad9c4d7f2bb service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Refreshing instance network info cache due to event network-changed-603c0b2c-d13b-48d6-a1a0-77c17c62c23e. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:40:28.890978 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-dc6f7529-03e6-4733-894c-754b2030cc14 req-ccf40ebd-56a0-4446-9d99-fad9c4d7f2bb service nova] Acquiring lock "refresh_cache-edf92675-15b4-424f-85b5-80341e77b578" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:40:28.891381 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-dc6f7529-03e6-4733-894c-754b2030cc14 req-ccf40ebd-56a0-4446-9d99-fad9c4d7f2bb service nova] Acquired lock "refresh_cache-edf92675-15b4-424f-85b5-80341e77b578" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:40:28.891816 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-dc6f7529-03e6-4733-894c-754b2030cc14 req-ccf40ebd-56a0-4446-9d99-fad9c4d7f2bb service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Refreshing network info cache for port 603c0b2c-d13b-48d6-a1a0-77c17c62c23e {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:40:29.058882 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.79', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003731', 'execute': None}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:40:29.072070 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.scaleio [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98967) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 10:40:29.103687 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Running cmd (subprocess): nvme version {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:29.166437 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] 'nvme version' failed. Not Retrying. {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 10:40:29.167271 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.nvmeof [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] nvme not present on system {{(pid=98967) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 10:40:29.177481 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98967) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 10:40:29.180950 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.lightos [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Current host hostNQN and IP(s) are ['10.4.3.79', 'fe80::f816:3eff:fe55:ba34', '192.168.40.6', 'fe80::f816:3eff:fe6b:fe1a', '192.168.50.6', 'fe80::f816:3eff:feca:9cd0', '192.168.10.6', 'fe80::f816:3eff:feb4:4e78', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f8bb:38ff:fe28:ff4a', 'fe80::fc16:3eff:fe37:b3f6', 'fe80::41a:feff:fe02:479d', 'fe80::fc16:3eff:fe5e:459', 'fe80::fc16:3eff:fe90:be9c', 'fe80::84cb:23ff:fe8e:e6e6', 'fe80::fc16:3eff:fe5a:811a', 'fe80::fc16:3eff:fe1b:5509', 'fe80::fc16:3eff:fef2:781c', 'fe80::b448:c6ff:fe9c:a1e9', 'fe80::fc16:3eff:fe43:d828', 'fe80::fc16:3eff:fefd:1020', 'fe80::fc16:3eff:fe17:f5ed', 'fe80::e4d7:e7ff:fe80:d900', 'fe80::fc16:3eff:feec:35bf', 'fe80::fc16:3eff:fe52:9c9b', 'fe80::fc16:3eff:feac:bc0b', 'fe80::fc16:3eff:feb3:64e7', 'fe80::fc16:3eff:fe6a:a465', 'fe80::6cd3:9eff:fe53:c46c', 'fe80::bc4e:7ff:fef8:a00a', 'fe80::fc16:3eff:fea4:49e7', 'fe80::acbf:48ff:fe2a:f93b', 'fe80::fc16:3eff:fe0e:19b0', 'fe80::fc16:3eff:fe78:446c', 'fe80::fc16:3eff:fe48:bca4', 'fe80::fc16:3eff:fe85:e3e8'] Jun 26 10:40:29.181211 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 10:40:29.181211 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] LIGHTOS: no hostnqn found. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 10:40:29.181627 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.79', 'host': 'np0000003731', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:2fddcc2116d6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '7f2a0776-2f14-4357-a22e-baa6677eb22e', 'nvme_native_multipath': False} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:40:29.191543 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Successfully created port: 3edf5060-42d2-4da0-8072-9aa340b3ddf5 {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:40:29.330821 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:29.337812 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Object Instance lazy-loaded attributes: numa_topology,resources {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:40:29.340096 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1844479358',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-attachvolumeshelvetestjson-server-1844479358',id=21,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGT3OPooMXq6iVcWa/Fwd14Ks/bkgC0xhuWPvKDIBt4A/bbkEKcU9puz90qHDGD6yfeUp0YpMtCA+rPiBhD1nHMQaj8vN/wAcXoQ6VCsvKjnCh464ti06dZKcXcP2/fnUg==',key_name='tempest-keypair-52848182',keypairs=,launch_index=0,launched_at=2026-06-26T10:39:35Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=4,progress=0,project_id='39600b204ad64a6db28676693c86dd70',ramdisk_id='',reservation_id='r-25v3smsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-959960600',owner_user_name='tempest-AttachVolumeShelveTestJSON-959960600-project-member',shelved_at='2026-06-26T10:40:25.376140',shelved_host='np0000003731',shelved_image_id='6e289f27-47a0-43f7-a307-065de0dfc62a'},tags=,task_state='shelving_offloading',terminated_at=None,trusted_certs=,updated_at=2026-06-26T10:40:22Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a7c139c060e4c998d31cf957835db61',uuid=edf92675-15b4-424f-85b5-80341e77b578,vcpu_model=,vcpus=1,vm_mode=None,vm_state='shelved') vif={"id": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "address": "fa:16:3e:97:32:1f", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap603c0b2c-d1", "ovs_interfaceid": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 26 10:40:29.343040 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Converting VIF {"id": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "address": "fa:16:3e:97:32:1f", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap603c0b2c-d1", "ovs_interfaceid": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:40:29.344747 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:32:1f,bridge_name='br-int',has_traffic_filtering=True,id=603c0b2c-d13b-48d6-a1a0-77c17c62c23e,network=Network(79bcd519-98c3-4905-a83f-c080654f2cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603c0b2c-d1') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:40:29.352956 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:32:1f,bridge_name='br-int',has_traffic_filtering=True,id=603c0b2c-d13b-48d6-a1a0-77c17c62c23e,network=Network(79bcd519-98c3-4905-a83f-c080654f2cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603c0b2c-d1') {{(pid=98967) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 26 10:40:29.355818 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:29.356160 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap603c0b2c-d1, bridge=br-int, if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:29.357976 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:29.359098 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:29.360988 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:29.361579 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:29.361787 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=ca12e08b-4669-4454-a1be-19110169e2a0) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:29.362817 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:29.363312 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:29.365617 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:29.368241 np0000003731 nova-compute[98967]: INFO os_vif [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:32:1f,bridge_name='br-int',has_traffic_filtering=True,id=603c0b2c-d13b-48d6-a1a0-77c17c62c23e,network=Network(79bcd519-98c3-4905-a83f-c080654f2cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603c0b2c-d1') Jun 26 10:40:29.368576 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Deleting instance files /opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578_del Jun 26 10:40:29.374150 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Deletion of /opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578_del complete Jun 26 10:40:29.397519 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-dc6f7529-03e6-4733-894c-754b2030cc14 req-ccf40ebd-56a0-4446-9d99-fad9c4d7f2bb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:29.885425 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-dc6f7529-03e6-4733-894c-754b2030cc14 req-ccf40ebd-56a0-4446-9d99-fad9c4d7f2bb service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:29.892044 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:40:29.892044 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:40:29.986524 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Successfully updated port: 3edf5060-42d2-4da0-8072-9aa340b3ddf5 {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:40:29.995700 np0000003731 nova-compute[98967]: INFO nova.scheduler.client.report [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Deleted allocations for instance edf92675-15b4-424f-85b5-80341e77b578 Jun 26 10:40:30.079789 np0000003731 nova-compute[98967]: DEBUG oslo.service.backend._threading.loopingcall [-] Fixed interval looping call 'nova.servicegroup.drivers.db.DbDriver._report_state' sleeping for 119.50 seconds {{(pid=98967) _run_loop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_threading/loopingcall.py:125}} Jun 26 10:40:30.113491 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-dc6f7529-03e6-4733-894c-754b2030cc14 req-ccf40ebd-56a0-4446-9d99-fad9c4d7f2bb service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Updated VIF entry in instance network info cache for port 603c0b2c-d13b-48d6-a1a0-77c17c62c23e. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:40:30.113885 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-dc6f7529-03e6-4733-894c-754b2030cc14 req-ccf40ebd-56a0-4446-9d99-fad9c4d7f2bb service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Updating instance_info_cache with network_info: [{"id": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "address": "fa:16:3e:97:32:1f", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": null, "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "unbound", "details": {}, "devname": "tap603c0b2c-d1", "ovs_interfaceid": null, "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:40:30.366328 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Starting finish_migration {{(pid=98967) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12808}} Jun 26 10:40:30.367831 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Instance directory exists: not creating {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5217}} Jun 26 10:40:30.367965 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Creating image(s) Jun 26 10:40:30.368871 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:30.401497 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:40:30.460691 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.092s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:30.461309 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Checking if we can resize image /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk. size=1073741824 {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:178}} Jun 26 10:40:30.461683 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:30.492997 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Acquiring lock "refresh_cache-619d915a-12c9-424f-8c12-b2a3f94a4109" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:40:30.493172 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Acquired lock "refresh_cache-619d915a-12c9-424f-8c12-b2a3f94a4109" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:40:30.493392 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:40:30.505627 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:30.554543 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk --force-share --output=json" returned: 0 in 0.093s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:30.554991 np0000003731 nova-compute[98967]: DEBUG nova.virt.disk.api [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Cannot resize image /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk to a smaller size. {{(pid=98967) can_resize_image /opt/stack/nova/nova/virt/disk/api.py:184}} Jun 26 10:40:30.616172 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-dc6f7529-03e6-4733-894c-754b2030cc14 req-ccf40ebd-56a0-4446-9d99-fad9c4d7f2bb service nova] Releasing lock "refresh_cache-edf92675-15b4-424f-85b5-80341e77b578" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:40:30.915996 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 3.368s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:30.916680 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Start building networks asynchronously for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3003}} Jun 26 10:40:30.920561 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.416s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:30.971668 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-252f33c0-e9a1-4861-8de4-e52c173cc9ed req-1afcc44a-5c8b-443f-95fd-e4d257ac756a service nova] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Received event network-changed-3edf5060-42d2-4da0-8072-9aa340b3ddf5 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:30.972409 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-252f33c0-e9a1-4861-8de4-e52c173cc9ed req-1afcc44a-5c8b-443f-95fd-e4d257ac756a service nova] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Refreshing instance network info cache due to event network-changed-3edf5060-42d2-4da0-8072-9aa340b3ddf5. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:40:30.972522 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-252f33c0-e9a1-4861-8de4-e52c173cc9ed req-1afcc44a-5c8b-443f-95fd-e4d257ac756a service nova] Acquiring lock "refresh_cache-619d915a-12c9-424f-8c12-b2a3f94a4109" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:40:31.057628 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Did not create local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 26 10:40:31.057889 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Ensure instance console log exists: /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/console.log {{(pid=98967) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 26 10:40:31.058321 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:31.058533 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:31.058731 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:31.061403 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Start _get_guest_xml network_info=[{"id": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "address": "fa:16:3e:9c:69:06", "network": {"id": "745fd3f4-1b5b-4135-add5-62d583152edb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1747333964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1747333964-network", "vif_mac": "fa:16:3e:9c:69:06"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13f2d75c17e64be5a0a5a2de4aaca2e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f36cb-f5", "ovs_interfaceid": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vdb': {'bus': 'virtio', 'dev': 'vdb', 'type': 'disk'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'image_id': 'a9b18127-6fee-4ed6-b364-a2d634ecb8b7'}], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'attaching', 'instance': '3a56a898-691e-473e-a5c1-d618e861087b', 'attached_at': '2026-06-26T10:40:29.000000', 'detached_at': '', 'volume_id': '40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'serial': '40e55112-eb2e-46ce-ba3b-b050f86c7c24'}, 'delete_on_termination': False, 'device_type': 'disk', 'guest_format': None, 'boot_index': None, 'disk_bus': 'virtio', 'mount_device': '/dev/vdb', 'attachment_id': '8c6f137a-bda6-4a44-8e08-0b4380d95721', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:40:31.067397 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:40:31.069511 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsTestOtherB-server-189933630', uuid='3a56a898-691e-473e-a5c1-d618e861087b'), owner=OwnerMeta(userid='3d2ca60f7c4f4cb5a413138ae1f040a7', username='tempest-ServerActionsTestOtherB-576427951-project-member', projectid='13f2d75c17e64be5a0a5a2de4aaca2e7', projectname='tempest-ServerActionsTestOtherB-576427951'), image=ImageMeta(id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.micro', flavorid='84', memory_mb=256, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "address": "fa:16:3e:9c:69:06", "network": {"id": "745fd3f4-1b5b-4135-add5-62d583152edb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1747333964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1747333964-network", "vif_mac": "fa:16:3e:9c:69:06"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13f2d75c17e64be5a0a5a2de4aaca2e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f36cb-f5", "ovs_interfaceid": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470431.0686202) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:40:31.070378 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:40:31.070855 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:40:31.072690 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:40:31.072899 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:40:31.074116 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:40:31.074500 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:49Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='84',id=12,is_public=True,memory_mb=256,name='m1.micro',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:40:31.074664 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:40:31.074801 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:40:31.074967 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:40:31.075119 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:40:31.075231 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:40:31.075425 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:40:31.075553 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:40:31.075706 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:40:31.075842 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:40:31.075989 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:40:31.089201 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk.config --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:31.204866 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk.config --force-share --output=json" returned: 0 in 0.115s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:31.205994 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquiring lock "/opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:31.206322 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "/opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:31.206918 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "/opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:31.207317 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Calling os-brick to attach iSCSI Volume {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 26 10:40:31.207708 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:40:31.207874 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:40:31.208210 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:40:31.208440 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 10:40:31.224948 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:40:31.225767 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:40:31.226509 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:40:31.226805 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:40:31.227379 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:40:31.227683 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:40:31.245141 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:40:31.245141 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:31.255065 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:40:31.255065 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:31.262071 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24] added Jun 26 10:40:31.262071 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:40:31.262071 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:40:31.262071 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:40:31.262071 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:40:31.262071 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:40:31.262071 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:31.262429 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:40:31.262639 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0349(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:40:31.262812 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:40:31.272762 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24] added Jun 26 10:40:31.272762 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:40:31.272762 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:40:31.272762 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:40:31.272762 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:40:31.272762 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:40:31.272762 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:31.273252 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:40:31.273252 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0464(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:40:31.273336 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:40:31.394639 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:31.430160 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Allocating IP information in the background. {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2148}} Jun 26 10:40:31.431133 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] allocate_for_instance() {{(pid=98967) allocate_for_instance /opt/stack/nova/nova/network/neutron.py:1186}} Jun 26 10:40:31.433249 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:31.433601 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:31.559613 np0000003731 nova-compute[98967]: DEBUG nova.policy [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Policy check for network:attach_external_network failed with credentials {'is_admin': False, 'user_id': '72704c563abb412aa2c238092bd55ec4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ea834a26efe148649425d3e02d974ef4', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=98967) authorize /opt/stack/nova/nova/policy.py:192}} Jun 26 10:40:31.898520 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:31.932188 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Ignoring supplied device name: /dev/vda. Libvirt can't honour user-supplied dev names Jun 26 10:40:32.144610 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Updating instance_info_cache with network_info: [{"id": "0825879a-7c75-4a22-b61e-d9289b60926b", "address": "fa:16:3e:a4:49:e7", "network": {"id": "9d61e079-8b68-4387-9c86-1e9172058c20", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-936629968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d10b4c2e162455786d5aa40d72a31c7", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0825879a-7c", "ovs_interfaceid": "0825879a-7c75-4a22-b61e-d9289b60926b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3edf5060-42d2-4da0-8072-9aa340b3ddf5", "address": "fa:16:3e:80:7d:0d", "network": {"id": "d31aa207-2dbc-4f10-a12c-622a7ebf9af7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-108444478", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d10b4c2e162455786d5aa40d72a31c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edf5060-42", "ovs_interfaceid": "3edf5060-42d2-4da0-8072-9aa340b3ddf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:40:32.192737 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:40:32.194271 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:40:32.246677 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Successfully created port: b456b506-7aaf-4c28-a7ed-bcbb16898b49 {{(pid=98967) _create_port_minimal /opt/stack/nova/nova/network/neutron.py:531}} Jun 26 10:40:32.263299 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:40:32.273737 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.50.100 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:40:32.280821 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.40.100 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:40:32.288325 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:32.294816 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:32.303215 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:32.319298 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:32.319298 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:32.319298 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:32.319298 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:32.319298 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:32.319298 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:32.319298 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:32.319298 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:32.319298 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:32.319298 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:32.319298 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:32.319298 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:32.319298 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:32.319298 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:32.319298 np0000003731 nova-compute[98967]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:32.319298 np0000003731 nova-compute[98967]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:32.319298 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:40:32.319998 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:32.319998 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:32.319998 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:32.319998 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:32.319998 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:32.319998 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:32.319998 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:32.319998 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:32.319998 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:32.319998 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:32.319998 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:32.319998 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:32.319998 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:32.319998 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:32.319998 np0000003731 nova-compute[98967]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:32.319998 np0000003731 nova-compute[98967]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:32.319998 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:40:32.327694 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:32.327694 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:32.327694 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:32.327694 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:32.327694 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:32.327694 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:32.327694 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:32.327694 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:32.327694 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:32.327694 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:32.327694 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:32.327694 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:32.327694 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:32.327694 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:32.327694 np0000003731 nova-compute[98967]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:32.327694 np0000003731 nova-compute[98967]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:32.327694 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:40:32.328312 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:32.328312 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:32.328312 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:32.328312 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:32.328312 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:32.328312 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:32.328312 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:32.328312 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:32.328312 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:32.328312 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:32.328312 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:32.328312 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:32.328312 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:32.328312 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:32.328312 np0000003731 nova-compute[98967]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:32.328312 np0000003731 nova-compute[98967]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:32.328312 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:40:32.436595 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Start building block device mappings for instance. {{(pid=98967) _build_resources /opt/stack/nova/nova/compute/manager.py:3038}} Jun 26 10:40:32.520253 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:32.520560 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:32.521667 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:32.521667 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:32.521667 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:32.528843 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Terminating instance Jun 26 10:40:32.556595 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:32.646900 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Releasing lock "refresh_cache-619d915a-12c9-424f-8c12-b2a3f94a4109" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:40:32.648281 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-252f33c0-e9a1-4861-8de4-e52c173cc9ed req-1afcc44a-5c8b-443f-95fd-e4d257ac756a service nova] Acquired lock "refresh_cache-619d915a-12c9-424f-8c12-b2a3f94a4109" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:40:32.648568 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-252f33c0-e9a1-4861-8de4-e52c173cc9ed req-1afcc44a-5c8b-443f-95fd-e4d257ac756a service nova] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Refreshing network info cache for port 3edf5060-42d2-4da0-8072-9aa340b3ddf5 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:40:32.651529 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:39:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1329602566',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-1329602566',id=23,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPv9SUt9TdjN5OZ4Ypk2xTwDqORSk7I6hErYKR7wNppYsK22T4j5VWZStNGf7JdUDmoiKJG45UqJOBREGbXYHEWrXxZJ7lAQaFPzSP5N0HdEGBWxH/KmemEWI0PPG+MHA==',key_name='tempest-keypair-1334314580',keypairs=,launch_index=0,launched_at=2026-06-26T10:39:48Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003731',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4d10b4c2e162455786d5aa40d72a31c7',ramdisk_id='',reservation_id='r-dhr2xu20',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1829838869',owner_user_name='tempest-TaggedAttachmentsTest-1829838869-project-member'},tags=,task_state=None,terminated_at=None,trusted_certs=,updated_at=2026-06-26T10:39:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2182fde17d0f447c971e388b65911648',uuid=619d915a-12c9-424f-8c12-b2a3f94a4109,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3edf5060-42d2-4da0-8072-9aa340b3ddf5", "address": "fa:16:3e:80:7d:0d", "network": {"id": "d31aa207-2dbc-4f10-a12c-622a7ebf9af7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-108444478", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d10b4c2e162455786d5aa40d72a31c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edf5060-42", "ovs_interfaceid": "3edf5060-42d2-4da0-8072-9aa340b3ddf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:40:32.651842 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Converting VIF {"id": "3edf5060-42d2-4da0-8072-9aa340b3ddf5", "address": "fa:16:3e:80:7d:0d", "network": {"id": "d31aa207-2dbc-4f10-a12c-622a7ebf9af7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-108444478", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d10b4c2e162455786d5aa40d72a31c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edf5060-42", "ovs_interfaceid": "3edf5060-42d2-4da0-8072-9aa340b3ddf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:40:32.652753 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:7d:0d,bridge_name='br-int',has_traffic_filtering=True,id=3edf5060-42d2-4da0-8072-9aa340b3ddf5,network=Network(d31aa207-2dbc-4f10-a12c-622a7ebf9af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3edf5060-42') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:40:32.652962 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:7d:0d,bridge_name='br-int',has_traffic_filtering=True,id=3edf5060-42d2-4da0-8072-9aa340b3ddf5,network=Network(d31aa207-2dbc-4f10-a12c-622a7ebf9af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3edf5060-42') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:40:32.656304 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:32.657416 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:32.657819 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:40:32.659873 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:32.660314 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '3e274a99-45de-52b0-9e64-e77a3ccd7402', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:32.661943 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:32.662678 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:32.668407 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:32.668937 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap3edf5060-42, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:32.674789 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap3edf5060-42, col_values=(('qos', UUID('c6ec75b2-62fc-46c5-94b8-ccf4740a9cdc')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:32.675842 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap3edf5060-42, col_values=(('external_ids', {'iface-id': '3edf5060-42d2-4da0-8072-9aa340b3ddf5', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:80:7d:0d', 'vm-uuid': '619d915a-12c9-424f-8c12-b2a3f94a4109'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:32.678338 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:32.679971 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:32.690963 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:32.692355 np0000003731 nova-compute[98967]: INFO os_vif [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:80:7d:0d,bridge_name='br-int',has_traffic_filtering=True,id=3edf5060-42d2-4da0-8072-9aa340b3ddf5,network=Network(d31aa207-2dbc-4f10-a12c-622a7ebf9af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3edf5060-42') Jun 26 10:40:32.694066 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:39:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1329602566',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-1329602566',id=23,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPv9SUt9TdjN5OZ4Ypk2xTwDqORSk7I6hErYKR7wNppYsK22T4j5VWZStNGf7JdUDmoiKJG45UqJOBREGbXYHEWrXxZJ7lAQaFPzSP5N0HdEGBWxH/KmemEWI0PPG+MHA==',key_name='tempest-keypair-1334314580',keypairs=,launch_index=0,launched_at=2026-06-26T10:39:48Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003731',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='4d10b4c2e162455786d5aa40d72a31c7',ramdisk_id='',reservation_id='r-dhr2xu20',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1829838869',owner_user_name='tempest-TaggedAttachmentsTest-1829838869-project-member'},tags=,task_state=None,terminated_at=None,trusted_certs=,updated_at=2026-06-26T10:39:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2182fde17d0f447c971e388b65911648',uuid=619d915a-12c9-424f-8c12-b2a3f94a4109,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3edf5060-42d2-4da0-8072-9aa340b3ddf5", "address": "fa:16:3e:80:7d:0d", "network": {"id": "d31aa207-2dbc-4f10-a12c-622a7ebf9af7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-108444478", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d10b4c2e162455786d5aa40d72a31c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edf5060-42", "ovs_interfaceid": "3edf5060-42d2-4da0-8072-9aa340b3ddf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:40:32.694066 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Converting VIF {"id": "3edf5060-42d2-4da0-8072-9aa340b3ddf5", "address": "fa:16:3e:80:7d:0d", "network": {"id": "d31aa207-2dbc-4f10-a12c-622a7ebf9af7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-108444478", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d10b4c2e162455786d5aa40d72a31c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edf5060-42", "ovs_interfaceid": "3edf5060-42d2-4da0-8072-9aa340b3ddf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:40:32.694747 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:80:7d:0d,bridge_name='br-int',has_traffic_filtering=True,id=3edf5060-42d2-4da0-8072-9aa340b3ddf5,network=Network(d31aa207-2dbc-4f10-a12c-622a7ebf9af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3edf5060-42') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:40:32.697460 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:40:32.705306 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] attach device xml: Jun 26 10:40:32.705306 np0000003731 nova-compute[98967]: Jun 26 10:40:32.705306 np0000003731 nova-compute[98967]: Jun 26 10:40:32.705306 np0000003731 nova-compute[98967]: Jun 26 10:40:32.705306 np0000003731 nova-compute[98967]: Jun 26 10:40:32.705306 np0000003731 nova-compute[98967]: Jun 26 10:40:32.705306 np0000003731 nova-compute[98967]: Jun 26 10:40:32.705306 np0000003731 nova-compute[98967]: {{(pid=98967) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 26 10:40:32.721349 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:32.804080 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:32.805574 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:32.852376 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:32.942456 np0000003731 nova-compute[98967]: INFO nova.virt.block_device [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Booting with volume-backed-image a9b18127-6fee-4ed6-b364-a2d634ecb8b7 at /dev/vda Jun 26 10:40:33.037865 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Start destroying the instance on the hypervisor. {{(pid=98967) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 26 10:40:33.083233 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Successfully updated port: b456b506-7aaf-4c28-a7ed-bcbb16898b49 {{(pid=98967) _update_port /opt/stack/nova/nova/network/neutron.py:569}} Jun 26 10:40:33.111245 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:33.131602 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-d36184ba-5ef7-42fd-9243-bca064f96002 req-ee9c014b-2384-412d-9c1e-3340cba40fc7 service nova] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Received event network-vif-plugged-3edf5060-42d2-4da0-8072-9aa340b3ddf5 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:33.131602 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-d36184ba-5ef7-42fd-9243-bca064f96002 req-ee9c014b-2384-412d-9c1e-3340cba40fc7 service nova] Acquiring lock "619d915a-12c9-424f-8c12-b2a3f94a4109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:33.133053 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-d36184ba-5ef7-42fd-9243-bca064f96002 req-ee9c014b-2384-412d-9c1e-3340cba40fc7 service nova] Lock "619d915a-12c9-424f-8c12-b2a3f94a4109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:33.133053 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-d36184ba-5ef7-42fd-9243-bca064f96002 req-ee9c014b-2384-412d-9c1e-3340cba40fc7 service nova] Lock "619d915a-12c9-424f-8c12-b2a3f94a4109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:33.133053 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-d36184ba-5ef7-42fd-9243-bca064f96002 req-ee9c014b-2384-412d-9c1e-3340cba40fc7 service nova] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] No waiting events found dispatching network-vif-plugged-3edf5060-42d2-4da0-8072-9aa340b3ddf5 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:33.133053 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-d36184ba-5ef7-42fd-9243-bca064f96002 req-ee9c014b-2384-412d-9c1e-3340cba40fc7 service nova] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Received unexpected event network-vif-plugged-3edf5060-42d2-4da0-8072-9aa340b3ddf5 for instance with vm_state active and task_state None. Jun 26 10:40:33.158308 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-252f33c0-e9a1-4861-8de4-e52c173cc9ed req-1afcc44a-5c8b-443f-95fd-e4d257ac756a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:33.186819 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-4938d80e-062c-44f8-b539-480719866051 req-1273ffcb-3eaf-4e97-882e-3598a750dd4a service nova] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Received event network-changed-b456b506-7aaf-4c28-a7ed-bcbb16898b49 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:33.190782 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-4938d80e-062c-44f8-b539-480719866051 req-1273ffcb-3eaf-4e97-882e-3598a750dd4a service nova] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Refreshing instance network info cache due to event network-changed-b456b506-7aaf-4c28-a7ed-bcbb16898b49. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:40:33.190782 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-4938d80e-062c-44f8-b539-480719866051 req-1273ffcb-3eaf-4e97-882e-3598a750dd4a service nova] Acquiring lock "refresh_cache-7edf2e67-5bc5-420a-8674-997ea5a30152" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:40:33.190782 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-4938d80e-062c-44f8-b539-480719866051 req-1273ffcb-3eaf-4e97-882e-3598a750dd4a service nova] Acquired lock "refresh_cache-7edf2e67-5bc5-420a-8674-997ea5a30152" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:40:33.190782 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-4938d80e-062c-44f8-b539-480719866051 req-1273ffcb-3eaf-4e97-882e-3598a750dd4a service nova] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Refreshing network info cache for port b456b506-7aaf-4c28-a7ed-bcbb16898b49 {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:40:33.212508 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.290s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:33.243928 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:33.252523 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:33.257642 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:33.281996 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:33.295153 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.001048638999918694 future=) submitted to {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:33.295153 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:33.295805 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=3.8447588809999615 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:33.295805 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=3.8434420549999686 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:33.298699 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Emitting event Stopped> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:40:33.298699 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] VM Stopped (Lifecycle Event) Jun 26 10:40:33.384586 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:33.392857 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:33.398459 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24, portal: 192.168.50.100,3260] Jun 26 10:40:33.398459 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24, portal: 192.168.50.100,3260] successful. Jun 26 10:40:33.398459 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:33.403142 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24, portal: 192.168.40.100,3260] Jun 26 10:40:33.403142 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24, portal: 192.168.40.100,3260] successful. Jun 26 10:40:33.403142 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:33.430899 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:33.442370 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:33.449373 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:33.453205 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:33.457175 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:33.463677 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:40:33.465810 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.237s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:40:33.465810 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Connected to 192.168.50.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:40:33.465810 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] HCTL ('23', '-', '-', 0) found on session 40 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:40:33.472719 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Scanning host 23 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:33.482079 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:40:33.483777 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 2.256s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:40:33.483777 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Connected to 192.168.40.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:40:33.489210 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] HCTL ('24', '-', '-', 0) found on session 41 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:40:33.492802 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Scanning host 24 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:40:33.509959 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Searching for a device in session 40 and hctl ['23', '*', '*', 0] yield: sdr {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:40:33.510219 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Connected to sdr using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:40:33.528180 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Searching for a device in session 41 and hctl ['24', '*', '*', 0] yield: sds {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:40:33.528180 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Connected to sds using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:40:33.563435 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b9fbc85e-371b-4ed0-bc73-012d639a4340 req-b7b4ee53-1a21-493f-a1a4-e9fb6986d227 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-unplugged-49031ae0-122b-4f20-8d73-20048a6ad965 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:33.563781 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b9fbc85e-371b-4ed0-bc73-012d639a4340 req-b7b4ee53-1a21-493f-a1a4-e9fb6986d227 service nova] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:33.564453 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b9fbc85e-371b-4ed0-bc73-012d639a4340 req-b7b4ee53-1a21-493f-a1a4-e9fb6986d227 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:33.564453 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b9fbc85e-371b-4ed0-bc73-012d639a4340 req-b7b4ee53-1a21-493f-a1a4-e9fb6986d227 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:33.564453 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b9fbc85e-371b-4ed0-bc73-012d639a4340 req-b7b4ee53-1a21-493f-a1a4-e9fb6986d227 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] No waiting events found dispatching network-vif-unplugged-49031ae0-122b-4f20-8d73-20048a6ad965 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:33.564750 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b9fbc85e-371b-4ed0-bc73-012d639a4340 req-b7b4ee53-1a21-493f-a1a4-e9fb6986d227 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-unplugged-49031ae0-122b-4f20-8d73-20048a6ad965 for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:40:33.572444 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:33.586471 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "refresh_cache-7edf2e67-5bc5-420a-8674-997ea5a30152" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:40:33.594293 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:33.657825 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:33.705179 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-4938d80e-062c-44f8-b539-480719866051 req-1273ffcb-3eaf-4e97-882e-3598a750dd4a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:33.743402 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-e7b5cc24-ad2b-4fa3-b7c0-a7b1e78375a2 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "edf92675-15b4-424f-85b5-80341e77b578" "released" by "nova.compute.manager.ComputeManager.shelve_instance..do_shelve_instance" :: held 16.828s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:33.774353 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:33.807223 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-2ab2f9f8-1b9e-4e2d-8555-2c07bdd0b0e6 tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:40:33.845446 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:33.892209 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:33.931597 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-4938d80e-062c-44f8-b539-480719866051 req-1273ffcb-3eaf-4e97-882e-3598a750dd4a service nova] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:40:33.938500 np0000003731 nova-compute[98967]: DEBUG nova.utils [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Queued Task(fn=>, remaining_delay=14.980820431999973 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:33.948717 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Instance destroyed successfully. Jun 26 10:40:33.951351 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lazy-loading 'resources' on Instance uuid ee4d14ad-8bd2-4b8b-9526-51abafe757f2 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:33.958819 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.043964 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.095490 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-252f33c0-e9a1-4861-8de4-e52c173cc9ed req-1afcc44a-5c8b-443f-95fd-e4d257ac756a service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:34.185918 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.231047 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 26 10:40:34.271235 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.276912 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.367133 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-4938d80e-062c-44f8-b539-480719866051 req-1273ffcb-3eaf-4e97-882e-3598a750dd4a service nova] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:40:34.379523 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.425991 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.439265 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:40:34.439265 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:40:34.439265 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] No VIF found with MAC fa:16:3e:a4:49:e7, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:40:34.456655 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.460722 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-973724914',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-973724914',id=15,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXXNelE8aiksVglbu5IxieekgunImq0N8+gB4i90SwlKOgJ5jLGESQZW447OC9RX/nj6CZ9Xqc+BXv17PDZZ0k5ralnrDScL3N6RSoxQIMTo0XHVyGosZZTWsRkqiRsVA==',key_name='tempest-keypair-933133359',keypairs=,launch_index=0,launched_at=2026-06-26T10:39:23Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='ed3cec81bee74bf3913ab4fcab11a000',ramdisk_id='',reservation_id='r-u7cn8k51',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2003689595',owner_user_name='tempest-TaggedBootDevicesTest_v242-2003689595-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-26T10:39:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad8d119c32e141afa9b00aa63bcc6770',uuid=ee4d14ad-8bd2-4b8b-9526-51abafe757f2,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "49031ae0-122b-4f20-8d73-20048a6ad965", "address": "fa:16:3e:fd:10:20", "network": {"id": "8142386b-fc69-434d-9373-4536e94d3e62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-385739110-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49031ae0-12", "ovs_interfaceid": "49031ae0-122b-4f20-8d73-20048a6ad965", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 26 10:40:34.460722 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converting VIF {"id": "49031ae0-122b-4f20-8d73-20048a6ad965", "address": "fa:16:3e:fd:10:20", "network": {"id": "8142386b-fc69-434d-9373-4536e94d3e62", "bridge": "br-int", "label": "tempest-TaggedBootDevicesTest_v242-385739110-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.196", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap49031ae0-12", "ovs_interfaceid": "49031ae0-122b-4f20-8d73-20048a6ad965", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:40:34.462750 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:fd:10:20,bridge_name='br-int',has_traffic_filtering=True,id=49031ae0-122b-4f20-8d73-20048a6ad965,network=Network(8142386b-fc69-434d-9373-4536e94d3e62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49031ae0-12') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:40:34.463196 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:10:20,bridge_name='br-int',has_traffic_filtering=True,id=49031ae0-122b-4f20-8d73-20048a6ad965,network=Network(8142386b-fc69-434d-9373-4536e94d3e62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49031ae0-12') {{(pid=98967) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 26 10:40:34.467762 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.468101 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap49031ae0-12, bridge=br-int, if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:34.469783 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.470726 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:34.492855 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-252f33c0-e9a1-4861-8de4-e52c173cc9ed req-1afcc44a-5c8b-443f-95fd-e4d257ac756a service nova] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Updated VIF entry in instance network info cache for port 3edf5060-42d2-4da0-8072-9aa340b3ddf5. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:40:34.492855 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-252f33c0-e9a1-4861-8de4-e52c173cc9ed req-1afcc44a-5c8b-443f-95fd-e4d257ac756a service nova] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Updating instance_info_cache with network_info: [{"id": "0825879a-7c75-4a22-b61e-d9289b60926b", "address": "fa:16:3e:a4:49:e7", "network": {"id": "9d61e079-8b68-4387-9c86-1e9172058c20", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-936629968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d10b4c2e162455786d5aa40d72a31c7", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0825879a-7c", "ovs_interfaceid": "0825879a-7c75-4a22-b61e-d9289b60926b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3edf5060-42d2-4da0-8072-9aa340b3ddf5", "address": "fa:16:3e:80:7d:0d", "network": {"id": "d31aa207-2dbc-4f10-a12c-622a7ebf9af7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-108444478", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d10b4c2e162455786d5aa40d72a31c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edf5060-42", "ovs_interfaceid": "3edf5060-42d2-4da0-8072-9aa340b3ddf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:40:34.544165 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.547032 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.547032 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=1de1b156-fb2f-45c2-8736-3203348332ac) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:34.548248 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.548869 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:34.632377 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.639294 np0000003731 nova-compute[98967]: INFO os_vif [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:fd:10:20,bridge_name='br-int',has_traffic_filtering=True,id=49031ae0-122b-4f20-8d73-20048a6ad965,network=Network(8142386b-fc69-434d-9373-4536e94d3e62),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap49031ae0-12') Jun 26 10:40:34.639294 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-973724914',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-973724914',id=15,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXXNelE8aiksVglbu5IxieekgunImq0N8+gB4i90SwlKOgJ5jLGESQZW447OC9RX/nj6CZ9Xqc+BXv17PDZZ0k5ralnrDScL3N6RSoxQIMTo0XHVyGosZZTWsRkqiRsVA==',key_name='tempest-keypair-933133359',keypairs=,launch_index=0,launched_at=2026-06-26T10:39:23Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='ed3cec81bee74bf3913ab4fcab11a000',ramdisk_id='',reservation_id='r-u7cn8k51',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2003689595',owner_user_name='tempest-TaggedBootDevicesTest_v242-2003689595-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-26T10:39:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad8d119c32e141afa9b00aa63bcc6770',uuid=ee4d14ad-8bd2-4b8b-9526-51abafe757f2,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "ebb9bc95-98ee-43f1-bd95-8a3da5497c72", "address": "fa:16:3e:17:f5:ed", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb9bc95-98", "ovs_interfaceid": "ebb9bc95-98ee-43f1-bd95-8a3da5497c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98967) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 26 10:40:34.639294 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converting VIF {"id": "ebb9bc95-98ee-43f1-bd95-8a3da5497c72", "address": "fa:16:3e:17:f5:ed", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.249", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapebb9bc95-98", "ovs_interfaceid": "ebb9bc95-98ee-43f1-bd95-8a3da5497c72", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:40:34.639294 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:17:f5:ed,bridge_name='br-int',has_traffic_filtering=True,id=ebb9bc95-98ee-43f1-bd95-8a3da5497c72,network=Network(31cceee4-a969-4779-8176-2f0fe765d595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapebb9bc95-98') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:40:34.639294 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:f5:ed,bridge_name='br-int',has_traffic_filtering=True,id=ebb9bc95-98ee-43f1-bd95-8a3da5497c72,network=Network(31cceee4-a969-4779-8176-2f0fe765d595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapebb9bc95-98') {{(pid=98967) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 26 10:40:34.655143 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.655143 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapebb9bc95-98, bridge=br-int, if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:34.655143 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:34.687797 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.695023 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.695023 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f429f636-ab05-4bb9-842f-3aa9c8220937) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:34.696071 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.697163 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:34.730202 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.732463 np0000003731 nova-compute[98967]: INFO os_vif [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:17:f5:ed,bridge_name='br-int',has_traffic_filtering=True,id=ebb9bc95-98ee-43f1-bd95-8a3da5497c72,network=Network(31cceee4-a969-4779-8176-2f0fe765d595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapebb9bc95-98') Jun 26 10:40:34.733393 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-973724914',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-973724914',id=15,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXXNelE8aiksVglbu5IxieekgunImq0N8+gB4i90SwlKOgJ5jLGESQZW447OC9RX/nj6CZ9Xqc+BXv17PDZZ0k5ralnrDScL3N6RSoxQIMTo0XHVyGosZZTWsRkqiRsVA==',key_name='tempest-keypair-933133359',keypairs=,launch_index=0,launched_at=2026-06-26T10:39:23Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='ed3cec81bee74bf3913ab4fcab11a000',ramdisk_id='',reservation_id='r-u7cn8k51',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2003689595',owner_user_name='tempest-TaggedBootDevicesTest_v242-2003689595-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-26T10:39:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad8d119c32e141afa9b00aa63bcc6770',uuid=ee4d14ad-8bd2-4b8b-9526-51abafe757f2,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "dcce8bc4-9171-4ef4-b762-37d89aea863b", "address": "fa:16:3e:ec:35:bf", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcce8bc4-91", "ovs_interfaceid": "dcce8bc4-9171-4ef4-b762-37d89aea863b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98967) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 26 10:40:34.733632 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converting VIF {"id": "dcce8bc4-9171-4ef4-b762-37d89aea863b", "address": "fa:16:3e:ec:35:bf", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapdcce8bc4-91", "ovs_interfaceid": "dcce8bc4-9171-4ef4-b762-37d89aea863b", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": true, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:40:34.734276 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ec:35:bf,bridge_name='br-int',has_traffic_filtering=True,id=dcce8bc4-9171-4ef4-b762-37d89aea863b,network=Network(31cceee4-a969-4779-8176-2f0fe765d595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdcce8bc4-91') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:40:34.734790 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:35:bf,bridge_name='br-int',has_traffic_filtering=True,id=dcce8bc4-9171-4ef4-b762-37d89aea863b,network=Network(31cceee4-a969-4779-8176-2f0fe765d595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdcce8bc4-91') {{(pid=98967) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 26 10:40:34.736257 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.736586 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapdcce8bc4-91, bridge=br-int, if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:34.740304 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.742578 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:34.764030 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.765385 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.765864 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=f07addf2-c998-4f83-8d7a-88872e64cbab) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:34.769048 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.772250 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:34.792896 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.795129 np0000003731 nova-compute[98967]: INFO os_vif [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ec:35:bf,bridge_name='br-int',has_traffic_filtering=True,id=dcce8bc4-9171-4ef4-b762-37d89aea863b,network=Network(31cceee4-a969-4779-8176-2f0fe765d595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=True,vif_name='tapdcce8bc4-91') Jun 26 10:40:34.795842 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-973724914',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-973724914',id=15,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXXNelE8aiksVglbu5IxieekgunImq0N8+gB4i90SwlKOgJ5jLGESQZW447OC9RX/nj6CZ9Xqc+BXv17PDZZ0k5ralnrDScL3N6RSoxQIMTo0XHVyGosZZTWsRkqiRsVA==',key_name='tempest-keypair-933133359',keypairs=,launch_index=0,launched_at=2026-06-26T10:39:23Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='ed3cec81bee74bf3913ab4fcab11a000',ramdisk_id='',reservation_id='r-u7cn8k51',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2003689595',owner_user_name='tempest-TaggedBootDevicesTest_v242-2003689595-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-26T10:39:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad8d119c32e141afa9b00aa63bcc6770',uuid=ee4d14ad-8bd2-4b8b-9526-51abafe757f2,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "9882d815-8273-4eb8-937b-a1c1e4af4018", "address": "fa:16:3e:52:9c:9b", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9882d815-82", "ovs_interfaceid": "9882d815-8273-4eb8-937b-a1c1e4af4018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 26 10:40:34.796071 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converting VIF {"id": "9882d815-8273-4eb8-937b-a1c1e4af4018", "address": "fa:16:3e:52:9c:9b", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.34", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap9882d815-82", "ovs_interfaceid": "9882d815-8273-4eb8-937b-a1c1e4af4018", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:40:34.796602 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:52:9c:9b,bridge_name='br-int',has_traffic_filtering=True,id=9882d815-8273-4eb8-937b-a1c1e4af4018,network=Network(31cceee4-a969-4779-8176-2f0fe765d595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9882d815-82') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:40:34.796862 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:9c:9b,bridge_name='br-int',has_traffic_filtering=True,id=9882d815-8273-4eb8-937b-a1c1e4af4018,network=Network(31cceee4-a969-4779-8176-2f0fe765d595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9882d815-82') {{(pid=98967) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 26 10:40:34.797952 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.798321 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap9882d815-82, bridge=br-int, if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:34.800132 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.801256 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:34.816568 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.817980 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.818295 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=969bbc3c-a42f-4b90-ac82-3eca90f4edfb) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:34.819223 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.819733 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:34.835868 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.838389 np0000003731 nova-compute[98967]: INFO os_vif [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:52:9c:9b,bridge_name='br-int',has_traffic_filtering=True,id=9882d815-8273-4eb8-937b-a1c1e4af4018,network=Network(31cceee4-a969-4779-8176-2f0fe765d595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap9882d815-82') Jun 26 10:40:34.839473 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-973724914',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-973724914',id=15,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXXNelE8aiksVglbu5IxieekgunImq0N8+gB4i90SwlKOgJ5jLGESQZW447OC9RX/nj6CZ9Xqc+BXv17PDZZ0k5ralnrDScL3N6RSoxQIMTo0XHVyGosZZTWsRkqiRsVA==',key_name='tempest-keypair-933133359',keypairs=,launch_index=0,launched_at=2026-06-26T10:39:23Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='ed3cec81bee74bf3913ab4fcab11a000',ramdisk_id='',reservation_id='r-u7cn8k51',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2003689595',owner_user_name='tempest-TaggedBootDevicesTest_v242-2003689595-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-26T10:39:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad8d119c32e141afa9b00aa63bcc6770',uuid=ee4d14ad-8bd2-4b8b-9526-51abafe757f2,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "8d782392-1caa-4b0a-b7e2-58c03357a004", "address": "fa:16:3e:ac:bc:0b", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d782392-1c", "ovs_interfaceid": "8d782392-1caa-4b0a-b7e2-58c03357a004", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 26 10:40:34.839707 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converting VIF {"id": "8d782392-1caa-4b0a-b7e2-58c03357a004", "address": "fa:16:3e:ac:bc:0b", "network": {"id": "31cceee4-a969-4779-8176-2f0fe765d595", "bridge": "br-int", "label": "tempest-device-tagging-net1-1943226255", "subnets": [{"cidr": "10.1.1.0/24", "dns": [], "gateway": {"address": "10.1.1.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.1.24", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap8d782392-1c", "ovs_interfaceid": "8d782392-1caa-4b0a-b7e2-58c03357a004", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:40:34.840397 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:ac:bc:0b,bridge_name='br-int',has_traffic_filtering=True,id=8d782392-1caa-4b0a-b7e2-58c03357a004,network=Network(31cceee4-a969-4779-8176-2f0fe765d595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d782392-1c') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:40:34.841555 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:bc:0b,bridge_name='br-int',has_traffic_filtering=True,id=8d782392-1caa-4b0a-b7e2-58c03357a004,network=Network(31cceee4-a969-4779-8176-2f0fe765d595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d782392-1c') {{(pid=98967) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 26 10:40:34.842437 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.842753 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap8d782392-1c, bridge=br-int, if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:34.844276 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.845162 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:34.858262 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.859831 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.860101 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=cb0307b6-0039-4926-9fe1-216158a0a23e) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:34.861798 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.862589 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:34.866888 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-4938d80e-062c-44f8-b539-480719866051 req-1273ffcb-3eaf-4e97-882e-3598a750dd4a service nova] Releasing lock "refresh_cache-7edf2e67-5bc5-420a-8674-997ea5a30152" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:40:34.867150 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquired lock "refresh_cache-7edf2e67-5bc5-420a-8674-997ea5a30152" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:40:34.867283 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:40:34.876302 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.880817 np0000003731 nova-compute[98967]: INFO os_vif [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:ac:bc:0b,bridge_name='br-int',has_traffic_filtering=True,id=8d782392-1caa-4b0a-b7e2-58c03357a004,network=Network(31cceee4-a969-4779-8176-2f0fe765d595),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap8d782392-1c') Jun 26 10:40:34.881828 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-973724914',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-973724914',id=15,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXXNelE8aiksVglbu5IxieekgunImq0N8+gB4i90SwlKOgJ5jLGESQZW447OC9RX/nj6CZ9Xqc+BXv17PDZZ0k5ralnrDScL3N6RSoxQIMTo0XHVyGosZZTWsRkqiRsVA==',key_name='tempest-keypair-933133359',keypairs=,launch_index=0,launched_at=2026-06-26T10:39:23Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='ed3cec81bee74bf3913ab4fcab11a000',ramdisk_id='',reservation_id='r-u7cn8k51',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2003689595',owner_user_name='tempest-TaggedBootDevicesTest_v242-2003689595-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-26T10:39:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad8d119c32e141afa9b00aa63bcc6770',uuid=ee4d14ad-8bd2-4b8b-9526-51abafe757f2,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "45a4f3f8-69ee-4cc0-811e-a1178c8b18f2", "address": "fa:16:3e:b3:64:e7", "network": {"id": "567865ec-590f-489f-ba94-79b2150230b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-814227769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a4f3f8-69", "ovs_interfaceid": "45a4f3f8-69ee-4cc0-811e-a1178c8b18f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 26 10:40:34.882104 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converting VIF {"id": "45a4f3f8-69ee-4cc0-811e-a1178c8b18f2", "address": "fa:16:3e:b3:64:e7", "network": {"id": "567865ec-590f-489f-ba94-79b2150230b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-814227769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.100", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap45a4f3f8-69", "ovs_interfaceid": "45a4f3f8-69ee-4cc0-811e-a1178c8b18f2", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:40:34.882908 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:b3:64:e7,bridge_name='br-int',has_traffic_filtering=True,id=45a4f3f8-69ee-4cc0-811e-a1178c8b18f2,network=Network(567865ec-590f-489f-ba94-79b2150230b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45a4f3f8-69') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:40:34.883768 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:64:e7,bridge_name='br-int',has_traffic_filtering=True,id=45a4f3f8-69ee-4cc0-811e-a1178c8b18f2,network=Network(567865ec-590f-489f-ba94-79b2150230b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45a4f3f8-69') {{(pid=98967) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 26 10:40:34.885136 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.885486 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap45a4f3f8-69, bridge=br-int, if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:34.887784 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.889365 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:34.897925 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.901018 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.901018 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=5dbb6c78-f7fd-4b84-9c67-b94e36e446e6) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:34.905368 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.906145 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:34.911079 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.919134 np0000003731 nova-compute[98967]: INFO os_vif [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:b3:64:e7,bridge_name='br-int',has_traffic_filtering=True,id=45a4f3f8-69ee-4cc0-811e-a1178c8b18f2,network=Network(567865ec-590f-489f-ba94-79b2150230b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap45a4f3f8-69') Jun 26 10:40:34.919134 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:34Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-973724914',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-973724914',id=15,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFXXNelE8aiksVglbu5IxieekgunImq0N8+gB4i90SwlKOgJ5jLGESQZW447OC9RX/nj6CZ9Xqc+BXv17PDZZ0k5ralnrDScL3N6RSoxQIMTo0XHVyGosZZTWsRkqiRsVA==',key_name='tempest-keypair-933133359',keypairs=,launch_index=0,launched_at=2026-06-26T10:39:23Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='ed3cec81bee74bf3913ab4fcab11a000',ramdisk_id='',reservation_id='r-u7cn8k51',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedBootDevicesTest_v242-2003689595',owner_user_name='tempest-TaggedBootDevicesTest_v242-2003689595-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-26T10:39:23Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='ad8d119c32e141afa9b00aa63bcc6770',uuid=ee4d14ad-8bd2-4b8b-9526-51abafe757f2,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "c2ff0bc1-8b84-4517-b347-f78bb6a9e14c", "address": "fa:16:3e:6a:a4:65", "network": {"id": "567865ec-590f-489f-ba94-79b2150230b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-814227769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ff0bc1-8b", "ovs_interfaceid": "c2ff0bc1-8b84-4517-b347-f78bb6a9e14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 26 10:40:34.919134 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converting VIF {"id": "c2ff0bc1-8b84-4517-b347-f78bb6a9e14c", "address": "fa:16:3e:6a:a4:65", "network": {"id": "567865ec-590f-489f-ba94-79b2150230b9", "bridge": "br-int", "label": "tempest-device-tagging-net2-814227769", "subnets": [{"cidr": "10.2.2.0/24", "dns": [], "gateway": {"address": "10.2.2.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.2.2.200", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ed3cec81bee74bf3913ab4fcab11a000", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapc2ff0bc1-8b", "ovs_interfaceid": "c2ff0bc1-8b84-4517-b347-f78bb6a9e14c", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:40:34.919134 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:6a:a4:65,bridge_name='br-int',has_traffic_filtering=True,id=c2ff0bc1-8b84-4517-b347-f78bb6a9e14c,network=Network(567865ec-590f-489f-ba94-79b2150230b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ff0bc1-8b') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:40:34.919134 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Unplugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:a4:65,bridge_name='br-int',has_traffic_filtering=True,id=c2ff0bc1-8b84-4517-b347-f78bb6a9e14c,network=Network(567865ec-590f-489f-ba94-79b2150230b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ff0bc1-8b') {{(pid=98967) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 26 10:40:34.919134 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.919134 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapc2ff0bc1-8b, bridge=br-int, if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:34.919821 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.920587 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:34.921730 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.923232 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=6acc1314-6a0c-4493-8886-6e9c9f935144) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:34.923435 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.924222 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:34.924939 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:34.928697 np0000003731 nova-compute[98967]: INFO os_vif [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Successfully unplugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:6a:a4:65,bridge_name='br-int',has_traffic_filtering=True,id=c2ff0bc1-8b84-4517-b347-f78bb6a9e14c,network=Network(567865ec-590f-489f-ba94-79b2150230b9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapc2ff0bc1-8b') Jun 26 10:40:34.932270 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] calling os-brick to detach iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 26 10:40:34.932674 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2', 'iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fe657ee-bc44-41d2-b197-f986995424e2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, None), 'kwargs': {'force': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:40:34.932975 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:40:34.946884 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='tempest-device-tagging-server-1329602566', uuid='619d915a-12c9-424f-8c12-b2a3f94a4109'), owner=OwnerMeta(userid='2182fde17d0f447c971e388b65911648', username='tempest-TaggedAttachmentsTest-1829838869-project-member', projectid='4d10b4c2e162455786d5aa40d72a31c7', projectname='tempest-TaggedAttachmentsTest-1829838869'), image=ImageMeta(id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "0825879a-7c75-4a22-b61e-d9289b60926b", "address": "fa:16:3e:a4:49:e7", "network": {"id": "9d61e079-8b68-4387-9c86-1e9172058c20", "bridge": "br-int", "label": "tempest-TaggedAttachmentsTest-936629968-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.13", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.69", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d10b4c2e162455786d5aa40d72a31c7", "mtu": null, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap0825879a-7c", "ovs_interfaceid": "0825879a-7c75-4a22-b61e-d9289b60926b", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}, {"id": "3edf5060-42d2-4da0-8072-9aa340b3ddf5", "address": "fa:16:3e:80:7d:0d", "network": {"id": "d31aa207-2dbc-4f10-a12c-622a7ebf9af7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-108444478", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d10b4c2e162455786d5aa40d72a31c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edf5060-42", "ovs_interfaceid": "3edf5060-42d2-4da0-8072-9aa340b3ddf5", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470434.946286) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] set metadata xml: Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: tempest-device-tagging-server-1329602566 Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: 2026-06-26 10:40:34 Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: 192 Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: 0 Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: 0 Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: True Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: bare Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: 0 Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: ide Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: virtio Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: pc Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: virtio Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: virtio Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: virtio Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: tempest-TaggedAttachmentsTest-1829838869-project-member Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: tempest-TaggedAttachmentsTest-1829838869 Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: Jun 26 10:40:34.947574 np0000003731 nova-compute[98967]: {{(pid=98967) set_metadata /opt/stack/nova/nova/virt/libvirt/guest.py:371}} Jun 26 10:40:34.995430 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-252f33c0-e9a1-4861-8de4-e52c173cc9ed req-1afcc44a-5c8b-443f-95fd-e4d257ac756a service nova] Releasing lock "refresh_cache-619d915a-12c9-424f-8c12-b2a3f94a4109" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:40:35.253330 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Found WWN 330000000e9c36c73 for multipath device dm-14 {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 26 10:40:35.254444 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 4.045s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:40:35.254444 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] <== connect_volume: return (4046ms) {'type': 'block', 'scsi_wwn': '330000000e9c36c73', 'path': '/dev/dm-14', 'multipath_id': '330000000e9c36c73'} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:40:35.254444 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e9c36c73', 'path': '/dev/dm-14', 'multipath_id': '330000000e9c36c73'} {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 26 10:40:35.256609 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.324s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:40:35.257334 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2', 'iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0fe657ee-bc44-41d2-b197-f986995424e2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-3'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 10:40:35.257334 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2', 0)] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 10:40:35.278135 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Received event network-vif-plugged-3edf5060-42d2-4da0-8072-9aa340b3ddf5 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:35.278402 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] Acquiring lock "619d915a-12c9-424f-8c12-b2a3f94a4109-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:35.278655 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] Lock "619d915a-12c9-424f-8c12-b2a3f94a4109-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:35.278811 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] Lock "619d915a-12c9-424f-8c12-b2a3f94a4109-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:35.279547 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] No waiting events found dispatching network-vif-plugged-3edf5060-42d2-4da0-8072-9aa340b3ddf5 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:35.279763 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Received unexpected event network-vif-plugged-3edf5060-42d2-4da0-8072-9aa340b3ddf5 for instance with vm_state active and task_state None. Jun 26 10:40:35.279991 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-unplugged-ebb9bc95-98ee-43f1-bd95-8a3da5497c72 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:35.280240 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:35.280481 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:35.280774 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:35.280801 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] No waiting events found dispatching network-vif-unplugged-ebb9bc95-98ee-43f1-bd95-8a3da5497c72 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:35.280914 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-unplugged-ebb9bc95-98ee-43f1-bd95-8a3da5497c72 for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:40:35.281051 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-unplugged-ebb9bc95-98ee-43f1-bd95-8a3da5497c72 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:35.281196 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:35.281352 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:35.281477 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:35.281641 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] No waiting events found dispatching network-vif-unplugged-ebb9bc95-98ee-43f1-bd95-8a3da5497c72 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:35.281758 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-unplugged-ebb9bc95-98ee-43f1-bd95-8a3da5497c72 for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:40:35.281898 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-unplugged-8d782392-1caa-4b0a-b7e2-58c03357a004 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:35.282582 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:35.282582 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:35.283661 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:35.283661 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] No waiting events found dispatching network-vif-unplugged-8d782392-1caa-4b0a-b7e2-58c03357a004 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:35.283661 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-unplugged-8d782392-1caa-4b0a-b7e2-58c03357a004 for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:40:35.283661 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-unplugged-8d782392-1caa-4b0a-b7e2-58c03357a004 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:35.283661 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:35.283661 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:35.283661 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:35.284283 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] No waiting events found dispatching network-vif-unplugged-8d782392-1caa-4b0a-b7e2-58c03357a004 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:35.284283 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-unplugged-8d782392-1caa-4b0a-b7e2-58c03357a004 for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:40:35.284651 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-unplugged-45a4f3f8-69ee-4cc0-811e-a1178c8b18f2 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:35.284915 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:35.285187 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:35.285297 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:35.285490 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] No waiting events found dispatching network-vif-unplugged-45a4f3f8-69ee-4cc0-811e-a1178c8b18f2 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:35.287489 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-17c0f309-392e-4e30-9c94-54609c8ad7c1 req-d7d6581a-6263-40bc-b8f6-8b83e31cb7bc service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-unplugged-45a4f3f8-69ee-4cc0-811e-a1178c8b18f2 for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:40:35.315223 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-8c6898a6-5f01-4094-b193-01a659294cca req-445109ec-069d-4c88-845c-39f924e2f85b service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-unplugged-c2ff0bc1-8b84-4517-b347-f78bb6a9e14c {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:35.315471 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-8c6898a6-5f01-4094-b193-01a659294cca req-445109ec-069d-4c88-845c-39f924e2f85b service nova] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:35.315703 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-8c6898a6-5f01-4094-b193-01a659294cca req-445109ec-069d-4c88-845c-39f924e2f85b service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:35.316153 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-8c6898a6-5f01-4094-b193-01a659294cca req-445109ec-069d-4c88-845c-39f924e2f85b service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:35.317896 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-8c6898a6-5f01-4094-b193-01a659294cca req-445109ec-069d-4c88-845c-39f924e2f85b service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] No waiting events found dispatching network-vif-unplugged-c2ff0bc1-8b84-4517-b347-f78bb6a9e14c {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:35.317896 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-8c6898a6-5f01-4094-b193-01a659294cca req-445109ec-069d-4c88-845c-39f924e2f85b service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-unplugged-c2ff0bc1-8b84-4517-b347-f78bb6a9e14c for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:40:35.317896 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-8c6898a6-5f01-4094-b193-01a659294cca req-445109ec-069d-4c88-845c-39f924e2f85b service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-unplugged-c2ff0bc1-8b84-4517-b347-f78bb6a9e14c {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:35.317896 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-8c6898a6-5f01-4094-b193-01a659294cca req-445109ec-069d-4c88-845c-39f924e2f85b service nova] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:35.317896 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-8c6898a6-5f01-4094-b193-01a659294cca req-445109ec-069d-4c88-845c-39f924e2f85b service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:35.317896 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-8c6898a6-5f01-4094-b193-01a659294cca req-445109ec-069d-4c88-845c-39f924e2f85b service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:35.317896 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-8c6898a6-5f01-4094-b193-01a659294cca req-445109ec-069d-4c88-845c-39f924e2f85b service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] No waiting events found dispatching network-vif-unplugged-c2ff0bc1-8b84-4517-b347-f78bb6a9e14c {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:35.317896 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-8c6898a6-5f01-4094-b193-01a659294cca req-445109ec-069d-4c88-845c-39f924e2f85b service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-unplugged-c2ff0bc1-8b84-4517-b347-f78bb6a9e14c for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:40:35.319425 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:35.319425 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:35.319425 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:35.319425 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:35.319425 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:35.319425 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:35.319425 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:35.319425 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:35.319425 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:35.319425 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:35.319425 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:35.319425 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:35.319425 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:35.319425 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:35.319425 np0000003731 nova-compute[98967]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:35.319425 np0000003731 nova-compute[98967]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:35.319425 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:35.319425 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:35.319425 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:40:35.320324 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:35.320324 np0000003731 nova-compute[98967]: tcp: [22] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:35.320324 np0000003731 nova-compute[98967]: tcp: [23] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2 (non-flash) Jun 26 10:40:35.320324 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:35.320324 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:35.320324 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:35.320324 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:35.320324 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:35.320324 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:35.320324 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:35.320324 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:35.320324 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:35.320324 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:35.320324 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:35.320324 np0000003731 nova-compute[98967]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:35.320324 np0000003731 nova-compute[98967]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:35.320324 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:35.320324 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:35.320324 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:40:35.320324 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '2'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2', '22'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2', '23'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2', '35'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', '41')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 10:40:35.320324 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2', '22')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:40:35.323660 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2', '23')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:40:35.326198 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Resulting device map defaultdict(. at 0x75f0702fd4e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2'): ({'sdd'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2'): ({'sde'}, set())}) {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 10:40:35.328368 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Removing multipathed devices sdd, sde {{(pid=98967) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 10:40:35.329238 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Flush multipath device 3300000009bb79ee9 {{(pid=98967) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 26 10:40:35.392959 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Remove SCSI device /dev/sdd with /sys/block/sdd/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:40:35.457478 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c4b8c7cd-202f-4195-9e01-ece0a1807a7d tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lock "interface-619d915a-12c9-424f-8c12-b2a3f94a4109-None" "released" by "nova.compute.manager.ComputeManager.attach_interface..do_attach_interface" :: held 8.219s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:35.462115 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Remove SCSI device /dev/sde with /sys/block/sde/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:40:35.477076 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Instance cache missing network info. {{(pid=98967) _get_preexisting_port_ids /opt/stack/nova/nova/network/neutron.py:3364}} Jun 26 10:40:35.514040 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Checking to see if SCSI volumes sdd, sde have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 10:40:35.514040 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] SCSI volumes sdd, sde have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 10:40:35.514040 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Checking to see if device paths {'sdd', 'sde'} are still under multipathd monitoring {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 10:40:35.530143 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Device paths {'sdd', 'sde'} have been removed from multipathd monitoring. {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 10:40:35.530143 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2')] {{(pid=98967) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 10:40:35.546136 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:35.564218 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "edf92675-15b4-424f-85b5-80341e77b578" by "nova.compute.manager.ComputeManager.unshelve_instance..do_unshelve_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:35.564890 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "edf92675-15b4-424f-85b5-80341e77b578" acquired by "nova.compute.manager.ComputeManager.unshelve_instance..do_unshelve_instance" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:35.565852 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Unshelving Jun 26 10:40:35.606918 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 22, target: iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2, portal: 192.168.40.100,3260] Jun 26 10:40:35.606918 np0000003731 nova-compute[98967]: Logout of [sid: 22, target: iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2, portal: 192.168.40.100,3260] successful. Jun 26 10:40:35.606918 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:35.638646 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:35.655701 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:35.682884 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b8aecf00-f107-4088-897d-b0a79e42f72d req-b8bfe6cb-f3b8-4071-b093-ad05601b12a9 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-unplugged-49031ae0-122b-4f20-8d73-20048a6ad965 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:35.683156 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b8aecf00-f107-4088-897d-b0a79e42f72d req-b8bfe6cb-f3b8-4071-b093-ad05601b12a9 service nova] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:35.683401 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b8aecf00-f107-4088-897d-b0a79e42f72d req-b8bfe6cb-f3b8-4071-b093-ad05601b12a9 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:35.683539 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b8aecf00-f107-4088-897d-b0a79e42f72d req-b8bfe6cb-f3b8-4071-b093-ad05601b12a9 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:35.683713 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b8aecf00-f107-4088-897d-b0a79e42f72d req-b8bfe6cb-f3b8-4071-b093-ad05601b12a9 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] No waiting events found dispatching network-vif-unplugged-49031ae0-122b-4f20-8d73-20048a6ad965 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:35.683850 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b8aecf00-f107-4088-897d-b0a79e42f72d req-b8bfe6cb-f3b8-4071-b093-ad05601b12a9 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-unplugged-49031ae0-122b-4f20-8d73-20048a6ad965 for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:40:35.684098 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b8aecf00-f107-4088-897d-b0a79e42f72d req-b8bfe6cb-f3b8-4071-b093-ad05601b12a9 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-unplugged-9882d815-8273-4eb8-937b-a1c1e4af4018 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:35.685542 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b8aecf00-f107-4088-897d-b0a79e42f72d req-b8bfe6cb-f3b8-4071-b093-ad05601b12a9 service nova] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:35.685542 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b8aecf00-f107-4088-897d-b0a79e42f72d req-b8bfe6cb-f3b8-4071-b093-ad05601b12a9 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:35.685542 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b8aecf00-f107-4088-897d-b0a79e42f72d req-b8bfe6cb-f3b8-4071-b093-ad05601b12a9 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:35.685748 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b8aecf00-f107-4088-897d-b0a79e42f72d req-b8bfe6cb-f3b8-4071-b093-ad05601b12a9 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] No waiting events found dispatching network-vif-unplugged-9882d815-8273-4eb8-937b-a1c1e4af4018 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:35.685905 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b8aecf00-f107-4088-897d-b0a79e42f72d req-b8bfe6cb-f3b8-4071-b093-ad05601b12a9 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-unplugged-9882d815-8273-4eb8-937b-a1c1e4af4018 for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:40:35.686090 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b8aecf00-f107-4088-897d-b0a79e42f72d req-b8bfe6cb-f3b8-4071-b093-ad05601b12a9 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-unplugged-9882d815-8273-4eb8-937b-a1c1e4af4018 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:35.686655 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b8aecf00-f107-4088-897d-b0a79e42f72d req-b8bfe6cb-f3b8-4071-b093-ad05601b12a9 service nova] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:35.687228 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b8aecf00-f107-4088-897d-b0a79e42f72d req-b8bfe6cb-f3b8-4071-b093-ad05601b12a9 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:35.687228 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-b8aecf00-f107-4088-897d-b0a79e42f72d req-b8bfe6cb-f3b8-4071-b093-ad05601b12a9 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:35.687324 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b8aecf00-f107-4088-897d-b0a79e42f72d req-b8bfe6cb-f3b8-4071-b093-ad05601b12a9 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] No waiting events found dispatching network-vif-unplugged-9882d815-8273-4eb8-937b-a1c1e4af4018 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:35.687440 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-b8aecf00-f107-4088-897d-b0a79e42f72d req-b8bfe6cb-f3b8-4071-b093-ad05601b12a9 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-unplugged-9882d815-8273-4eb8-937b-a1c1e4af4018 for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:40:35.692360 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:35.715965 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 23, target: iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2, portal: 192.168.50.100,3260] Jun 26 10:40:35.715965 np0000003731 nova-compute[98967]: Logout of [sid: 23, target: iqn.2023-03.storpool.com:os--volume-0fe657ee-bc44-41d2-b197-f986995424e2, portal: 192.168.50.100,3260] successful. Jun 26 10:40:35.715965 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:35.748379 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:35.748718 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.492s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:40:35.748983 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] <== disconnect_volume: return (816ms) None {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:40:35.749145 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Disconnected iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 26 10:40:35.756496 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] calling os-brick to detach iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 26 10:40:35.756903 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', 'iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:40:35.757125 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:40:35.757479 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:40:35.757773 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', 'iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 10:40:35.757938 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', 0)] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 10:40:35.768040 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-189933630',display_name='tempest-ServerActionsTestOtherB-server-189933630',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000003731',hostname='tempest-serveractionstestotherb-server-189933630',id=19,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDv+GLIZEgqCpG9Ar7Sy1trgWnL3YEyqFHnBU/WG9g4CSqyvLBbCulNghiyJn3KpB/3bSNsGv+SgxNXmmFNVCZyLb+bs7KEXcLVodWAftMPleXJm0MjBQWdyVYaPKr8FFQ==',key_name='tempest-keypair-1436363432',keypairs=,launch_index=0,launched_at=2026-06-26T10:39:14Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003731',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='13f2d75c17e64be5a0a5a2de4aaca2e7',ramdisk_id='',reservation_id='r-y898iga0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-576427951',owner_user_name='tempest-ServerActionsTestOtherB-576427951-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:40:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d2ca60f7c4f4cb5a413138ae1f040a7',uuid=3a56a898-691e-473e-a5c1-d618e861087b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "address": "fa:16:3e:9c:69:06", "network": {"id": "745fd3f4-1b5b-4135-add5-62d583152edb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1747333964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1747333964-network", "vif_mac": "fa:16:3e:9c:69:06"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13f2d75c17e64be5a0a5a2de4aaca2e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f36cb-f5", "ovs_interfaceid": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:40:35.768040 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Converting VIF {"id": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "address": "fa:16:3e:9c:69:06", "network": {"id": "745fd3f4-1b5b-4135-add5-62d583152edb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1747333964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1747333964-network", "vif_mac": "fa:16:3e:9c:69:06"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13f2d75c17e64be5a0a5a2de4aaca2e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f36cb-f5", "ovs_interfaceid": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:40:35.768040 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:69:06,bridge_name='br-int',has_traffic_filtering=True,id=fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df,network=Network(745fd3f4-1b5b-4135-add5-62d583152edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd2f36cb-f5') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] End _get_guest_xml xml= Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: 3a56a898-691e-473e-a5c1-d618e861087b Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: instance-00000013 Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: 262144 Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: tempest-ServerActionsTestOtherB-server-189933630 Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: 2026-06-26 10:40:31 Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: 256 Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: 0 Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: 0 Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: True Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: bare Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: 0 Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: ide Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: virtio Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: pc Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: virtio Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: virtio Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: virtio Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: tempest-ServerActionsTestOtherB-576427951-project-member Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: tempest-ServerActionsTestOtherB-576427951 Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: 3a56a898-691e-473e-a5c1-d618e861087b Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: 3a56a898-691e-473e-a5c1-d618e861087b Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: hvm Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: 128 Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: 40e55112-eb2e-46ce-ba3b-b050f86c7c24 Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: Jun 26 10:40:35.768456 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:40:35.773478 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-189933630',display_name='tempest-ServerActionsTestOtherB-server-189933630',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000003731',hostname='tempest-serveractionstestotherb-server-189933630',id=19,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDv+GLIZEgqCpG9Ar7Sy1trgWnL3YEyqFHnBU/WG9g4CSqyvLBbCulNghiyJn3KpB/3bSNsGv+SgxNXmmFNVCZyLb+bs7KEXcLVodWAftMPleXJm0MjBQWdyVYaPKr8FFQ==',key_name='tempest-keypair-1436363432',keypairs=,launch_index=0,launched_at=2026-06-26T10:39:14Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003731',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='13f2d75c17e64be5a0a5a2de4aaca2e7',ramdisk_id='',reservation_id='r-y898iga0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-576427951',owner_user_name='tempest-ServerActionsTestOtherB-576427951-project-member'},tags=,task_state='resize_finish',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:40:25Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d2ca60f7c4f4cb5a413138ae1f040a7',uuid=3a56a898-691e-473e-a5c1-d618e861087b,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "address": "fa:16:3e:9c:69:06", "network": {"id": "745fd3f4-1b5b-4135-add5-62d583152edb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1747333964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1747333964-network", "vif_mac": "fa:16:3e:9c:69:06"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13f2d75c17e64be5a0a5a2de4aaca2e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f36cb-f5", "ovs_interfaceid": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:40:35.773478 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Converting VIF {"id": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "address": "fa:16:3e:9c:69:06", "network": {"id": "745fd3f4-1b5b-4135-add5-62d583152edb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1747333964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}], "label": "tempest-ServerActionsTestOtherB-1747333964-network", "vif_mac": "fa:16:3e:9c:69:06"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13f2d75c17e64be5a0a5a2de4aaca2e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f36cb-f5", "ovs_interfaceid": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:40:35.773478 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:9c:69:06,bridge_name='br-int',has_traffic_filtering=True,id=fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df,network=Network(745fd3f4-1b5b-4135-add5-62d583152edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd2f36cb-f5') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:40:35.773478 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:69:06,bridge_name='br-int',has_traffic_filtering=True,id=fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df,network=Network(745fd3f4-1b5b-4135-add5-62d583152edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd2f36cb-f5') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:40:35.776257 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:35.776554 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:35.776800 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:40:35.780366 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:35.780671 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'c30be4f5-3492-5eed-a78c-3a6724cfe3b8', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:35.782114 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:35.782864 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:35.786690 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:35.794047 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:35.794047 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapfd2f36cb-f5, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:35.794047 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapfd2f36cb-f5, col_values=(('qos', UUID('b7402c81-f691-48e8-9a13-a48887d24474')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:35.794047 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapfd2f36cb-f5, col_values=(('external_ids', {'iface-id': 'fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:9c:69:06', 'vm-uuid': '3a56a898-691e-473e-a5c1-d618e861087b'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:35.797359 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:35.801433 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:35.813431 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:35.815433 np0000003731 nova-compute[98967]: INFO os_vif [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:9c:69:06,bridge_name='br-int',has_traffic_filtering=True,id=fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df,network=Network(745fd3f4-1b5b-4135-add5-62d583152edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd2f36cb-f5') Jun 26 10:40:35.816274 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:35.816274 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:35.816274 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:35.816274 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:35.816274 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:35.816274 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:35.816274 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:35.816274 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:35.816274 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:35.816274 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:35.816274 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:35.816274 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:35.816274 np0000003731 nova-compute[98967]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:35.816274 np0000003731 nova-compute[98967]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:35.816274 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:35.816274 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:35.816274 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:40:35.817561 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:35.817561 np0000003731 nova-compute[98967]: tcp: [24] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:35.817561 np0000003731 nova-compute[98967]: tcp: [25] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4 (non-flash) Jun 26 10:40:35.817561 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:35.817561 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:35.817561 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:35.817561 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:35.817561 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:35.817561 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:35.817561 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:35.817561 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:35.817561 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:35.817561 np0000003731 nova-compute[98967]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:35.817561 np0000003731 nova-compute[98967]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:35.817561 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:35.817561 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:35.817561 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:40:35.817561 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '2'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', '24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', '25'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2', '35'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', '41')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 10:40:35.817561 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', '24')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:40:35.824360 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4', '25')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:40:35.827239 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Resulting device map defaultdict(. at 0x75f07068d4e0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4'): ({'sdg'}, set())}) {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 10:40:35.827239 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Removing multipathed devices sdf, sdg {{(pid=98967) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 10:40:35.827239 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Flush multipath device 330000000ee608f42 {{(pid=98967) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 26 10:40:35.867892 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:40:35.936122 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Updating instance_info_cache with network_info: [{"id": "b456b506-7aaf-4c28-a7ed-bcbb16898b49", "address": "fa:16:3e:cb:d9:dc", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb456b506-7a", "ovs_interfaceid": "b456b506-7aaf-4c28-a7ed-bcbb16898b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:40:35.941751 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:40:36.003836 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 10:40:36.004355 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 10:40:36.006785 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 10:40:36.020260 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 10:40:36.020531 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4')] {{(pid=98967) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 10:40:36.033048 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:36.078410 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 24, target: iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4, portal: 192.168.40.100,3260] Jun 26 10:40:36.078410 np0000003731 nova-compute[98967]: Logout of [sid: 24, target: iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4, portal: 192.168.40.100,3260] successful. Jun 26 10:40:36.078410 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:36.103273 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:36.116276 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:36.167596 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 25, target: iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4, portal: 192.168.50.100,3260] Jun 26 10:40:36.167596 np0000003731 nova-compute[98967]: Logout of [sid: 25, target: iqn.2023-03.storpool.com:os--volume-3b80e3a9-1d96-48b3-99f7-ff6f6146fcc4, portal: 192.168.50.100,3260] successful. Jun 26 10:40:36.167596 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:36.190847 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:36.191105 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.434s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:40:36.191258 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] <== disconnect_volume: return (434ms) None {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:40:36.191416 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Disconnected iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 26 10:40:36.192717 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] calling os-brick to detach iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 26 10:40:36.193069 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d', 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eab5497d-64ad-45f7-af05-50cde809958d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, None), 'kwargs': {'force': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:40:36.193244 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:40:36.193733 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:40:36.194153 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d', 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'eab5497d-64ad-45f7-af05-50cde809958d', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-7'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 10:40:36.194313 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d', 0)] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 10:40:36.229099 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:36.229099 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:36.229099 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:36.229099 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:36.229099 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:36.229099 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:36.229099 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:36.229099 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:36.229099 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:36.229099 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:36.229099 np0000003731 nova-compute[98967]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:36.229099 np0000003731 nova-compute[98967]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:36.229099 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:36.229099 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:36.229099 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:40:36.229733 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:36.229733 np0000003731 nova-compute[98967]: tcp: [26] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:36.229733 np0000003731 nova-compute[98967]: tcp: [27] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d (non-flash) Jun 26 10:40:36.229733 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:36.229733 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:36.229733 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:36.229733 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:36.229733 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:36.229733 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:36.229733 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:36.229733 np0000003731 nova-compute[98967]: tcp: [38] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:36.229733 np0000003731 nova-compute[98967]: tcp: [39] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:36.229733 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:36.229733 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:36.229733 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:40:36.229733 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d', '26'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d', '27'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2', '35'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', '38'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', '39'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', '41')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 10:40:36.229733 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d', '27')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:40:36.232803 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d', '26')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:40:36.234916 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Resulting device map defaultdict(. at 0x75f0702fe2a0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d'): ({'sdi'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d'): ({'sdh'}, set())}) {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 10:40:36.235186 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Removing multipathed devices sdh, sdi {{(pid=98967) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 10:40:36.235484 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Flush multipath device 330000000e189e75e {{(pid=98967) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 26 10:40:36.276091 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Remove SCSI device /dev/sdh with /sys/block/sdh/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:40:36.340822 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Remove SCSI device /dev/sdi with /sys/block/sdi/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:40:36.403934 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Checking to see if SCSI volumes sdh, sdi have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 10:40:36.404424 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] SCSI volumes sdh, sdi have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 10:40:36.406632 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Checking to see if device paths {'sdh', 'sdi'} are still under multipathd monitoring {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 10:40:36.421137 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Device paths {'sdh', 'sdi'} have been removed from multipathd monitoring. {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 10:40:36.421357 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d')] {{(pid=98967) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 10:40:36.436697 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:36.438189 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Releasing lock "refresh_cache-7edf2e67-5bc5-420a-8674-997ea5a30152" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:40:36.438551 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Instance network_info: |[{"id": "b456b506-7aaf-4c28-a7ed-bcbb16898b49", "address": "fa:16:3e:cb:d9:dc", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb456b506-7a", "ovs_interfaceid": "b456b506-7aaf-4c28-a7ed-bcbb16898b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}]| {{(pid=98967) _allocate_network_async /opt/stack/nova/nova/compute/manager.py:2163}} Jun 26 10:40:36.489907 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 27, target: iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d, portal: 192.168.40.100,3260] Jun 26 10:40:36.489907 np0000003731 nova-compute[98967]: Logout of [sid: 27, target: iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d, portal: 192.168.40.100,3260] successful. Jun 26 10:40:36.489907 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:36.514523 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:36.528452 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:36.569761 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 26, target: iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d, portal: 192.168.50.100,3260] Jun 26 10:40:36.569761 np0000003731 nova-compute[98967]: Logout of [sid: 26, target: iqn.2023-03.storpool.com:os--volume-eab5497d-64ad-45f7-af05-50cde809958d, portal: 192.168.50.100,3260] successful. Jun 26 10:40:36.569761 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:36.587408 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Acquiring lock "619d915a-12c9-424f-8c12-b2a3f94a4109" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:36.587643 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lock "619d915a-12c9-424f-8c12-b2a3f94a4109" acquired by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:36.594469 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:36.594664 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.401s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:40:36.594793 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] <== disconnect_volume: return (401ms) None {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:40:36.594906 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Disconnected iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 26 10:40:36.595212 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Deleting instance files /opt/stack/data/nova/instances/ee4d14ad-8bd2-4b8b-9526-51abafe757f2_del Jun 26 10:40:36.595814 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Deletion of /opt/stack/data/nova/instances/ee4d14ad-8bd2-4b8b-9526-51abafe757f2_del complete Jun 26 10:40:36.642206 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:36.642497 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:36.645687 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lazy-loading 'pci_requests' on Instance uuid edf92675-15b4-424f-85b5-80341e77b578 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:36.991899 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.79', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003731', 'execute': None}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:40:37.003768 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.scaleio [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98967) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 10:40:37.032238 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): nvme version {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:37.074237 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] 'nvme version' failed. Not Retrying. {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 10:40:37.079554 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.nvmeof [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] nvme not present on system {{(pid=98967) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 10:40:37.091214 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98967) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 10:40:37.093161 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.lightos [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Current host hostNQN and IP(s) are ['10.4.3.79', 'fe80::f816:3eff:fe55:ba34', '192.168.40.6', 'fe80::f816:3eff:fe6b:fe1a', '192.168.50.6', 'fe80::f816:3eff:feca:9cd0', '192.168.10.6', 'fe80::f816:3eff:feb4:4e78', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f8bb:38ff:fe28:ff4a', 'fe80::fc16:3eff:fe37:b3f6', 'fe80::41a:feff:fe02:479d', 'fe80::fc16:3eff:fe5e:459', 'fe80::fc16:3eff:fe90:be9c', 'fe80::84cb:23ff:fe8e:e6e6', 'fe80::fc16:3eff:fe5a:811a', 'fe80::fc16:3eff:fe1b:5509', 'fe80::fc16:3eff:fef2:781c', 'fe80::b448:c6ff:fe9c:a1e9', 'fe80::fc16:3eff:fe43:d828', 'fe80::fc16:3eff:fea4:49e7', 'fe80::acbf:48ff:fe2a:f93b', 'fe80::fc16:3eff:fe0e:19b0', 'fe80::fc16:3eff:fe78:446c', 'fe80::fc16:3eff:fe48:bca4', 'fe80::fc16:3eff:fe85:e3e8', 'fe80::fc16:3eff:fe80:7d0d', 'fe80::b8e9:eaff:feee:4936'] Jun 26 10:40:37.093330 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 10:40:37.093479 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] LIGHTOS: no hostnqn found. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 10:40:37.093854 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] <== get_connector_properties: return (101ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.79', 'host': 'np0000003731', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:2fddcc2116d6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '7f2a0776-2f14-4357-a22e-baa6677eb22e', 'nvme_native_multipath': False} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:40:37.096052 np0000003731 nova-compute[98967]: DEBUG nova.virt.block_device [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Updating existing volume attachment record: c3698170-d67b-490c-941d-90c6c4fa5a0b {{(pid=98967) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 26 10:40:37.099294 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lazy-loading 'flavor' on Instance uuid 619d915a-12c9-424f-8c12-b2a3f94a4109 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:37.112787 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Took 4.07 seconds to destroy the instance on the hypervisor. Jun 26 10:40:37.114106 np0000003731 nova-compute[98967]: DEBUG oslo.service.backend._common.loopingcall [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98967) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 26 10:40:37.114545 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [-] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Deallocating network for instance {{(pid=98967) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 26 10:40:37.114614 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [-] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] deallocate_for_instance() {{(pid=98967) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 26 10:40:37.114950 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:37.142980 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.003676959000131319 future=) submitted to {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:37.143224 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:37.143891 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=2.1271918160000496 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:37.143891 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=2.1270937239999057 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:37.146224 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Emitting event Stopped> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:40:37.146224 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] VM Stopped (Lifecycle Event) Jun 26 10:40:37.149456 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lazy-loading 'numa_topology' on Instance uuid edf92675-15b4-424f-85b5-80341e77b578 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:37.348268 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:40:37.348440 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] No BDM found with device name vdb, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:40:37.348596 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:40:37.348755 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] No VIF found with MAC fa:16:3e:9c:69:06, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:40:37.349380 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Using config drive Jun 26 10:40:37.373359 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-495e7c89-85c6-46af-9017-36206b4b013b req-a9b039a4-33d6-447a-9386-3a1c832c7ec4 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-unplugged-45a4f3f8-69ee-4cc0-811e-a1178c8b18f2 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:37.373552 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-495e7c89-85c6-46af-9017-36206b4b013b req-a9b039a4-33d6-447a-9386-3a1c832c7ec4 service nova] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:37.373740 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-495e7c89-85c6-46af-9017-36206b4b013b req-a9b039a4-33d6-447a-9386-3a1c832c7ec4 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:37.373862 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-495e7c89-85c6-46af-9017-36206b4b013b req-a9b039a4-33d6-447a-9386-3a1c832c7ec4 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:37.374059 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-495e7c89-85c6-46af-9017-36206b4b013b req-a9b039a4-33d6-447a-9386-3a1c832c7ec4 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] No waiting events found dispatching network-vif-unplugged-45a4f3f8-69ee-4cc0-811e-a1178c8b18f2 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:37.374250 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-495e7c89-85c6-46af-9017-36206b4b013b req-a9b039a4-33d6-447a-9386-3a1c832c7ec4 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-unplugged-45a4f3f8-69ee-4cc0-811e-a1178c8b18f2 for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:40:37.400080 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:37.571146 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:37.647848 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:40:37.652953 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98967) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 26 10:40:37.656526 np0000003731 nova-compute[98967]: INFO nova.compute.claims [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Claim successful on node np0000003731 Jun 26 10:40:37.745799 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-67fbedba-8aa1-4c0f-b940-05008930dfdd req-57fd4c79-f04e-424b-a2ab-280fe0a7dc31 service nova] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Received event volume-reimaged-0838d3e5-41a4-4e26-b090-b276de7370ee {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:37.746677 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-67fbedba-8aa1-4c0f-b940-05008930dfdd req-57fd4c79-f04e-424b-a2ab-280fe0a7dc31 service nova] Acquiring lock "3dd6ac52-de12-47da-bc90-77d0fff44acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:37.746677 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-67fbedba-8aa1-4c0f-b940-05008930dfdd req-57fd4c79-f04e-424b-a2ab-280fe0a7dc31 service nova] Lock "3dd6ac52-de12-47da-bc90-77d0fff44acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:37.746884 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-67fbedba-8aa1-4c0f-b940-05008930dfdd req-57fd4c79-f04e-424b-a2ab-280fe0a7dc31 service nova] Lock "3dd6ac52-de12-47da-bc90-77d0fff44acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:37.747088 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-67fbedba-8aa1-4c0f-b940-05008930dfdd req-57fd4c79-f04e-424b-a2ab-280fe0a7dc31 service nova] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Processing event volume-reimaged-0838d3e5-41a4-4e26-b090-b276de7370ee {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:40:37.749735 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Instance event wait completed in 10 seconds for volume-reimaged {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:40:37.782594 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-e79590b5-9f99-4476-a86f-04faee12a4dc req-7f61b75d-0120-417b-bed5-3d80d531edb4 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-unplugged-dcce8bc4-9171-4ef4-b762-37d89aea863b {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:37.782857 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-e79590b5-9f99-4476-a86f-04faee12a4dc req-7f61b75d-0120-417b-bed5-3d80d531edb4 service nova] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:37.783377 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-e79590b5-9f99-4476-a86f-04faee12a4dc req-7f61b75d-0120-417b-bed5-3d80d531edb4 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:37.783462 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-e79590b5-9f99-4476-a86f-04faee12a4dc req-7f61b75d-0120-417b-bed5-3d80d531edb4 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:37.783672 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-e79590b5-9f99-4476-a86f-04faee12a4dc req-7f61b75d-0120-417b-bed5-3d80d531edb4 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] No waiting events found dispatching network-vif-unplugged-dcce8bc4-9171-4ef4-b762-37d89aea863b {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:37.784208 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-e79590b5-9f99-4476-a86f-04faee12a4dc req-7f61b75d-0120-417b-bed5-3d80d531edb4 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-unplugged-dcce8bc4-9171-4ef4-b762-37d89aea863b for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:40:37.784208 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-e79590b5-9f99-4476-a86f-04faee12a4dc req-7f61b75d-0120-417b-bed5-3d80d531edb4 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-unplugged-dcce8bc4-9171-4ef4-b762-37d89aea863b {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:37.784208 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-e79590b5-9f99-4476-a86f-04faee12a4dc req-7f61b75d-0120-417b-bed5-3d80d531edb4 service nova] Acquiring lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:37.784292 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-e79590b5-9f99-4476-a86f-04faee12a4dc req-7f61b75d-0120-417b-bed5-3d80d531edb4 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:37.784361 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-e79590b5-9f99-4476-a86f-04faee12a4dc req-7f61b75d-0120-417b-bed5-3d80d531edb4 service nova] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:37.784503 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-e79590b5-9f99-4476-a86f-04faee12a4dc req-7f61b75d-0120-417b-bed5-3d80d531edb4 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] No waiting events found dispatching network-vif-unplugged-dcce8bc4-9171-4ef4-b762-37d89aea863b {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:37.784660 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-e79590b5-9f99-4476-a86f-04faee12a4dc req-7f61b75d-0120-417b-bed5-3d80d531edb4 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-unplugged-dcce8bc4-9171-4ef4-b762-37d89aea863b for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:40:37.909049 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:37.948351 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:38.055086 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:38.124583 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lock "619d915a-12c9-424f-8c12-b2a3f94a4109" "released" by "nova.compute.manager.ComputeManager.reserve_block_device_name..do_reserve" :: held 1.537s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:38.226524 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7d448743-2672-4233-9341-eb8c32be6c39 req-02b01094-eda4-4a0e-8874-82b32ca26b41 service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Received event network-vif-plugged-fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:38.227434 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7d448743-2672-4233-9341-eb8c32be6c39 req-02b01094-eda4-4a0e-8874-82b32ca26b41 service nova] Acquiring lock "3a56a898-691e-473e-a5c1-d618e861087b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:38.227992 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7d448743-2672-4233-9341-eb8c32be6c39 req-02b01094-eda4-4a0e-8874-82b32ca26b41 service nova] Lock "3a56a898-691e-473e-a5c1-d618e861087b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:38.227992 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7d448743-2672-4233-9341-eb8c32be6c39 req-02b01094-eda4-4a0e-8874-82b32ca26b41 service nova] Lock "3a56a898-691e-473e-a5c1-d618e861087b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:38.227992 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7d448743-2672-4233-9341-eb8c32be6c39 req-02b01094-eda4-4a0e-8874-82b32ca26b41 service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] No waiting events found dispatching network-vif-plugged-fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:38.228288 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-7d448743-2672-4233-9341-eb8c32be6c39 req-02b01094-eda4-4a0e-8874-82b32ca26b41 service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Received unexpected event network-vif-plugged-fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df for instance with vm_state active and task_state resize_finish. Jun 26 10:40:38.259364 np0000003731 nova-compute[98967]: INFO nova.virt.block_device [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Booting with volume 0838d3e5-41a4-4e26-b090-b276de7370ee at /dev/vda Jun 26 10:40:38.326613 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.79', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003731', 'execute': None}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:40:38.341870 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.scaleio [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98967) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 10:40:38.342454 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:38.350055 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:38.352734 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:38.381900 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Running cmd (subprocess): nvme version {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:38.393345 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:38.424358 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] 'nvme version' failed. Not Retrying. {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 10:40:38.426607 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.nvmeof [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] nvme not present on system {{(pid=98967) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 10:40:38.443048 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98967) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 10:40:38.444289 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.lightos [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Current host hostNQN and IP(s) are ['10.4.3.79', 'fe80::f816:3eff:fe55:ba34', '192.168.40.6', 'fe80::f816:3eff:fe6b:fe1a', '192.168.50.6', 'fe80::f816:3eff:feca:9cd0', '192.168.10.6', 'fe80::f816:3eff:feb4:4e78', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f8bb:38ff:fe28:ff4a', 'fe80::fc16:3eff:fe37:b3f6', 'fe80::41a:feff:fe02:479d', 'fe80::fc16:3eff:fe5e:459', 'fe80::fc16:3eff:fe90:be9c', 'fe80::84cb:23ff:fe8e:e6e6', 'fe80::fc16:3eff:fe5a:811a', 'fe80::fc16:3eff:fe1b:5509', 'fe80::fc16:3eff:fef2:781c', 'fe80::b448:c6ff:fe9c:a1e9', 'fe80::fc16:3eff:fe43:d828', 'fe80::fc16:3eff:fea4:49e7', 'fe80::acbf:48ff:fe2a:f93b', 'fe80::fc16:3eff:fe0e:19b0', 'fe80::fc16:3eff:fe78:446c', 'fe80::fc16:3eff:fe48:bca4', 'fe80::fc16:3eff:fe85:e3e8', 'fe80::fc16:3eff:fe80:7d0d', 'fe80::b8e9:eaff:feee:4936', 'fe80::fc16:3eff:fe9c:6906', 'fe80::bc5e:80ff:fe69:218d'] Jun 26 10:40:38.444810 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 10:40:38.445169 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] LIGHTOS: no hostnqn found. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 10:40:38.445702 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] <== get_connector_properties: return (118ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.79', 'host': 'np0000003731', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:2fddcc2116d6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '7f2a0776-2f14-4357-a22e-baa6677eb22e', 'nvme_native_multipath': False} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:40:38.446203 np0000003731 nova-compute[98967]: DEBUG nova.virt.block_device [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Updating existing volume attachment record: 2bf45dde-f081-4f48-ae80-5c678b9ad00a {{(pid=98967) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 26 10:40:38.525030 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Stashing vm_state: active {{(pid=98967) _prep_resize /opt/stack/nova/nova/compute/manager.py:6338}} Jun 26 10:40:39.020115 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:40:39.020291 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] VM Resumed (Lifecycle Event) Jun 26 10:40:39.024580 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Instance event wait completed in 0 seconds for {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:40:39.029462 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Instance running successfully. Jun 26 10:40:39.033497 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Failed to set time: agent not configured {{(pid=98967) sync_guest_time /opt/stack/nova/nova/virt/libvirt/guest.py:194}} Jun 26 10:40:39.033748 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-81de1734-2296-4084-9c8c-f71dcfe7a2be tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] finish_migration finished successfully. {{(pid=98967) finish_migration /opt/stack/nova/nova/virt/libvirt/driver.py:12903}} Jun 26 10:40:39.102890 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:39.244141 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Acquiring lock "619d915a-12c9-424f-8c12-b2a3f94a4109" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:39.244141 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lock "619d915a-12c9-424f-8c12-b2a3f94a4109" acquired by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:39.244141 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Attaching volume f75790bf-71bb-4447-80b7-693d4f5a7065 to /dev/vdb Jun 26 10:40:39.271665 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.0006639260000156355 future=) submitted to {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:39.271665 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:39.271665 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=9.646914071000083 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:39.272192 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=9.64674349500001 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:39.273575 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Start spawning the instance on the hypervisor. {{(pid=98967) _build_and_run_instance /opt/stack/nova/nova/compute/manager.py:2811}} Jun 26 10:40:39.282342 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Emitting event Stopped> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:40:39.282342 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Creating instance directory {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 26 10:40:39.284634 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] VM Stopped (Lifecycle Event) Jun 26 10:40:39.287131 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Creating image(s) Jun 26 10:40:39.287616 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Did not create local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 26 10:40:39.287616 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Ensure instance console log exists: /opt/stack/data/nova/instances/7edf2e67-5bc5-420a-8674-997ea5a30152/console.log {{(pid=98967) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 26 10:40:39.289700 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:39.290076 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:39.290258 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:39.290988 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Start _get_guest_xml network_info=[{"id": "b456b506-7aaf-4c28-a7ed-bcbb16898b49", "address": "fa:16:3e:cb:d9:dc", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb456b506-7a", "ovs_interfaceid": "b456b506-7aaf-4c28-a7ed-bcbb16898b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6', 'iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f109100b-1f3d-418a-9112-045de874c2e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '7edf2e67-5bc5-420a-8674-997ea5a30152', 'attached_at': '', 'detached_at': '', 'volume_id': 'f109100b-1f3d-418a-9112-045de874c2e6', 'serial': 'f109100b-1f3d-418a-9112-045de874c2e6'}, 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': 'c3698170-d67b-490c-941d-90c6c4fa5a0b', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:40:39.299468 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:40:39.301070 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='tempest-ServerBootFromVolumeStableRescueTest-server-2016055428', uuid='7edf2e67-5bc5-420a-8674-997ea5a30152'), owner=OwnerMeta(userid='72704c563abb412aa2c238092bd55ec4', username='tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member', projectid='ea834a26efe148649425d3e02d974ef4', projectname='tempest-ServerBootFromVolumeStableRescueTest-618712607'), image=ImageMeta(id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "b456b506-7aaf-4c28-a7ed-bcbb16898b49", "address": "fa:16:3e:cb:d9:dc", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb456b506-7a", "ovs_interfaceid": "b456b506-7aaf-4c28-a7ed-bcbb16898b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470439.3005726) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:40:39.302446 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:40:39.303168 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:40:39.304098 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:40:39.304327 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:40:39.305423 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:40:39.305992 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='87617e24a5e30cb3b87fda8c0764838f',container_format='bare',created_at=2026-06-26T10:34:30Z,direct_url=,disk_format='qcow2',id=a9b18127-6fee-4ed6-b364-a2d634ecb8b7,min_disk=0,min_ram=0,name='cirros-0.6.3-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21692416,status='active',tags=,updated_at=2026-06-26T10:34:33Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:40:39.306655 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:40:39.306655 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:40:39.306655 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:40:39.306655 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:40:39.307270 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:40:39.307462 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:40:39.307655 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:40:39.308693 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:40:39.308693 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:40:39.308693 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:40:39.318460 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.79', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003731', 'execute': None}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:40:39.323382 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Calling os-brick to attach iSCSI Volume {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 26 10:40:39.323807 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6', 'iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f109100b-1f3d-418a-9112-045de874c2e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:40:39.323975 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:40:39.324360 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:40:39.324633 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6', 'iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f109100b-1f3d-418a-9112-045de874c2e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 10:40:39.341859 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.scaleio [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98967) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 10:40:39.350878 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:40:39.351783 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:40:39.352348 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:40:39.352697 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:40:39.354187 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:40:39.354524 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:40:39.373513 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:40:39.373513 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:39.373919 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Running cmd (subprocess): nvme version {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:39.391686 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:40:39.391686 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:39.395483 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6] added Jun 26 10:40:39.395483 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:40:39.395483 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:40:39.395483 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:40:39.395483 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:40:39.395483 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:40:39.395483 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:39.395839 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:40:39.396711 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0417(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:40:39.397096 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:40:39.406566 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6] added Jun 26 10:40:39.406566 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:40:39.406566 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:40:39.406566 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:40:39.406566 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:40:39.406566 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:40:39.406566 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:39.406795 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:40:39.407436 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0543(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:40:39.407664 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:40:39.430349 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] 'nvme version' failed. Not Retrying. {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 10:40:39.430638 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.nvmeof [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] nvme not present on system {{(pid=98967) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 10:40:39.438944 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98967) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 10:40:39.440576 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.lightos [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Current host hostNQN and IP(s) are ['10.4.3.79', 'fe80::f816:3eff:fe55:ba34', '192.168.40.6', 'fe80::f816:3eff:fe6b:fe1a', '192.168.50.6', 'fe80::f816:3eff:feca:9cd0', '192.168.10.6', 'fe80::f816:3eff:feb4:4e78', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f8bb:38ff:fe28:ff4a', 'fe80::fc16:3eff:fe37:b3f6', 'fe80::41a:feff:fe02:479d', 'fe80::fc16:3eff:fe5e:459', 'fe80::fc16:3eff:fe90:be9c', 'fe80::84cb:23ff:fe8e:e6e6', 'fe80::fc16:3eff:fe5a:811a', 'fe80::fc16:3eff:fe1b:5509', 'fe80::fc16:3eff:fef2:781c', 'fe80::b448:c6ff:fe9c:a1e9', 'fe80::fc16:3eff:fe43:d828', 'fe80::fc16:3eff:fea4:49e7', 'fe80::acbf:48ff:fe2a:f93b', 'fe80::fc16:3eff:fe0e:19b0', 'fe80::fc16:3eff:fe78:446c', 'fe80::fc16:3eff:fe48:bca4', 'fe80::fc16:3eff:fe85:e3e8', 'fe80::fc16:3eff:fe80:7d0d', 'fe80::b8e9:eaff:feee:4936', 'fe80::fc16:3eff:fe9c:6906', 'fe80::bc5e:80ff:fe69:218d'] Jun 26 10:40:39.440744 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 10:40:39.440899 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] LIGHTOS: no hostnqn found. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 10:40:39.441137 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] <== get_connector_properties: return (121ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.79', 'host': 'np0000003731', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:2fddcc2116d6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '7f2a0776-2f14-4357-a22e-baa6677eb22e', 'nvme_native_multipath': False} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:40:39.441387 np0000003731 nova-compute[98967]: DEBUG nova.virt.block_device [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Updating existing volume attachment record: 3497db55-273a-4357-9fce-9aef4461dcf1 {{(pid=98967) _volume_attach /opt/stack/nova/nova/virt/block_device.py:666}} Jun 26 10:40:39.527321 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:40:39.530274 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: resize_finish, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:40:39.668239 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-2a1ae48d-3e0c-4f14-9222-1509a93c9c15 req-f78ff15f-f200-40dd-b77e-0d9642545006 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-deleted-c2ff0bc1-8b84-4517-b347-f78bb6a9e14c {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:39.668437 np0000003731 nova-compute[98967]: INFO nova.compute.manager [req-2a1ae48d-3e0c-4f14-9222-1509a93c9c15 req-f78ff15f-f200-40dd-b77e-0d9642545006 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Neutron deleted interface c2ff0bc1-8b84-4517-b347-f78bb6a9e14c; detaching it from the instance and deleting it from the info cache Jun 26 10:40:39.675060 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-2a1ae48d-3e0c-4f14-9222-1509a93c9c15 req-f78ff15f-f200-40dd-b77e-0d9642545006 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Detach interface failed, port_id=c2ff0bc1-8b84-4517-b347-f78bb6a9e14c, reason: Instance ee4d14ad-8bd2-4b8b-9526-51abafe757f2 could not be found. {{(pid=98967) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 26 10:40:39.790836 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:40:39.848851 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:40:39.849102 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:40:39.990669 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Calling os-brick to attach iSCSI Volume {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 26 10:40:39.991042 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065', 'iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f75790bf-71bb-4447-80b7-693d4f5a7065', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:40:39.991195 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:40:40.037556 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] During sync_power_state the instance has a pending task (resize_finish). Skip. Jun 26 10:40:40.037909 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:40:40.038000 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] VM Started (Lifecycle Event) Jun 26 10:40:40.194337 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-0bbd528f-9245-4a8f-80e4-38580b14c79c req-16f26cdf-b262-46d7-91fb-9258379180d7 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-deleted-49031ae0-122b-4f20-8d73-20048a6ad965 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:40.194804 np0000003731 nova-compute[98967]: INFO nova.compute.manager [req-0bbd528f-9245-4a8f-80e4-38580b14c79c req-16f26cdf-b262-46d7-91fb-9258379180d7 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Neutron deleted interface 49031ae0-122b-4f20-8d73-20048a6ad965; detaching it from the instance and deleting it from the info cache Jun 26 10:40:40.196242 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-0bbd528f-9245-4a8f-80e4-38580b14c79c req-16f26cdf-b262-46d7-91fb-9258379180d7 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Detach interface failed, port_id=49031ae0-122b-4f20-8d73-20048a6ad965, reason: Instance ee4d14ad-8bd2-4b8b-9526-51abafe757f2 could not be found. {{(pid=98967) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 26 10:40:40.324415 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-69d32093-bd15-44a1-afcf-c131a22a2700 req-50b1d1de-4af9-4b60-8286-d54cd89a543a service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Received event network-vif-plugged-fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:40.324716 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-69d32093-bd15-44a1-afcf-c131a22a2700 req-50b1d1de-4af9-4b60-8286-d54cd89a543a service nova] Acquiring lock "3a56a898-691e-473e-a5c1-d618e861087b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:40.324927 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-69d32093-bd15-44a1-afcf-c131a22a2700 req-50b1d1de-4af9-4b60-8286-d54cd89a543a service nova] Lock "3a56a898-691e-473e-a5c1-d618e861087b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:40.325171 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-69d32093-bd15-44a1-afcf-c131a22a2700 req-50b1d1de-4af9-4b60-8286-d54cd89a543a service nova] Lock "3a56a898-691e-473e-a5c1-d618e861087b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:40.325337 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-69d32093-bd15-44a1-afcf-c131a22a2700 req-50b1d1de-4af9-4b60-8286-d54cd89a543a service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] No waiting events found dispatching network-vif-plugged-fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:40.325425 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-69d32093-bd15-44a1-afcf-c131a22a2700 req-50b1d1de-4af9-4b60-8286-d54cd89a543a service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Received unexpected event network-vif-plugged-fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df for instance with vm_state resized and task_state None. Jun 26 10:40:40.325673 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-69d32093-bd15-44a1-afcf-c131a22a2700 req-50b1d1de-4af9-4b60-8286-d54cd89a543a service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-deleted-45a4f3f8-69ee-4cc0-811e-a1178c8b18f2 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:40.326078 np0000003731 nova-compute[98967]: INFO nova.compute.manager [req-69d32093-bd15-44a1-afcf-c131a22a2700 req-50b1d1de-4af9-4b60-8286-d54cd89a543a service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Neutron deleted interface 45a4f3f8-69ee-4cc0-811e-a1178c8b18f2; detaching it from the instance and deleting it from the info cache Jun 26 10:40:40.327906 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-69d32093-bd15-44a1-afcf-c131a22a2700 req-50b1d1de-4af9-4b60-8286-d54cd89a543a service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Detach interface failed, port_id=45a4f3f8-69ee-4cc0-811e-a1178c8b18f2, reason: Instance ee4d14ad-8bd2-4b8b-9526-51abafe757f2 could not be found. {{(pid=98967) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 26 10:40:40.357631 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:40:40.397872 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:40:40.408223 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.50.100 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:40:40.419107 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.40.100 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:40:40.425244 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:40.440606 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:40.443648 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:40.462643 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:40.462643 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:40.462643 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:40.462643 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:40.462643 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:40.462643 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:40.462643 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:40.462643 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:40.462643 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:40.462643 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:40.462643 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:40:40.463729 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:40.463729 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:40.463729 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:40.463729 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:40.463729 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:40.463729 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:40.463729 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:40.463729 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:40.463729 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:40.463729 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:40.463729 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:40:40.465963 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-ec1952cf-1b09-4c45-875f-71fc3e0c5167 req-5c94a66b-cf4b-41d2-832e-731f925325fd service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-deleted-8d782392-1caa-4b0a-b7e2-58c03357a004 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:40.466267 np0000003731 nova-compute[98967]: INFO nova.compute.manager [req-ec1952cf-1b09-4c45-875f-71fc3e0c5167 req-5c94a66b-cf4b-41d2-832e-731f925325fd service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Neutron deleted interface 8d782392-1caa-4b0a-b7e2-58c03357a004; detaching it from the instance and deleting it from the info cache Jun 26 10:40:40.470360 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-ec1952cf-1b09-4c45-875f-71fc3e0c5167 req-5c94a66b-cf4b-41d2-832e-731f925325fd service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Detach interface failed, port_id=8d782392-1caa-4b0a-b7e2-58c03357a004, reason: Instance ee4d14ad-8bd2-4b8b-9526-51abafe757f2 could not be found. {{(pid=98967) _process_instance_vif_deleted_event /opt/stack/nova/nova/compute/manager.py:11817}} Jun 26 10:40:40.471766 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:40.471766 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:40.471766 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:40.471766 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:40.471766 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:40.471766 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:40.471766 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:40.471766 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:40.471766 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:40.471766 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:40.471766 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:40:40.472145 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:40.472145 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:40.472145 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:40.472145 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:40.472145 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:40.472145 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:40.472145 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:40.472145 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:40.472145 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:40.472145 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:40.472145 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:40:40.525263 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6, portal: 192.168.50.100,3260] Jun 26 10:40:40.525263 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6, portal: 192.168.50.100,3260] successful. Jun 26 10:40:40.525263 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:40.539070 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6, portal: 192.168.40.100,3260] Jun 26 10:40:40.539070 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6, portal: 192.168.40.100,3260] successful. Jun 26 10:40:40.539070 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:40.540585 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:40:40.541981 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:40.544612 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Synchronizing instance power state after lifecycle event "Started"; current vm_state: resized, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:40:40.554108 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:40.570523 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:40.570523 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:40.570523 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:40.570523 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:40.570523 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:40.570523 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:40.570523 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:40.570523 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:40.570523 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:40.570523 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:40.570523 np0000003731 nova-compute[98967]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:40.570523 np0000003731 nova-compute[98967]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:40.570523 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:40:40.571680 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:40.571680 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:40.571680 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:40.571680 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:40.571680 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:40.571680 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:40.571680 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:40.571680 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:40.571680 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:40.571680 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:40.571680 np0000003731 nova-compute[98967]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:40.571680 np0000003731 nova-compute[98967]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:40.571680 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:40:40.571680 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.217s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:40:40.574327 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Connected to 192.168.50.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:40:40.577293 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:40.577293 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:40.577293 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:40.577293 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:40.577293 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:40.577293 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:40.577293 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:40.577293 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:40.577293 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:40.577293 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:40.577293 np0000003731 nova-compute[98967]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:40.577293 np0000003731 nova-compute[98967]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:40.577293 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:40:40.577293 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:40.577293 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:40.577293 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:40.577293 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:40.577293 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:40.577293 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:40.577293 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:40.577293 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:40.577293 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:40.577293 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:40.577293 np0000003731 nova-compute[98967]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:40.577293 np0000003731 nova-compute[98967]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:40.577293 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:40:40.578023 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.225s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:40:40.578023 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Connected to 192.168.40.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:40:40.578772 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] HCTL ('9', '-', '-', 0) found on session 42 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:40:40.578880 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Scanning host 9 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:40:40.581816 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] HCTL ('10', '-', '-', 0) found on session 43 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:40:40.581816 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Scanning host 10 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:40:40.610534 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Searching for a device in session 43 and hctl ['10', '*', '*', 0] yield: None {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:40:40.610534 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Searching for a device in session 42 and hctl ['9', '*', '*', 0] yield: sdd {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:40:40.610534 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Connected to sdd using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f109100b-1f3d-418a-9112-045de874c2e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:40:40.625574 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Creating instance directory {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 26 10:40:40.625878 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Creating image(s) Jun 26 10:40:40.626400 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Did not create local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5365}} Jun 26 10:40:40.627374 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Ensure instance console log exists: /opt/stack/data/nova/instances/3dd6ac52-de12-47da-bc90-77d0fff44acf/console.log {{(pid=98967) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 26 10:40:40.627374 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:40.627374 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:40.627374 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:40.627972 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Start _get_guest_xml network_info=[{"id": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "address": "fa:16:3e:41:2f:75", "network": {"id": "66d12b1b-32f2-4152-b44c-13e5284b49f9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-186021134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a4e84471c94128b1ac4dd00ca7177b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap288e6be4-7a", "ovs_interfaceid": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, '/dev/vda': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-06-26T10:34:27Z,direct_url=,disk_format='qcow2',id=652e47dc-dbeb-4044-a4a6-a03fd1347421,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21233664,status='active',tags=,updated_at=2026-06-26T10:34:30Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [], 'ephemerals': [], 'block_device_mapping': [{'connection_info': {'driver_volume_type': 'iscsi', 'data': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0838d3e5-41a4-4e26-b090-b276de7370ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}, 'status': 'reserved', 'instance': '3dd6ac52-de12-47da-bc90-77d0fff44acf', 'attached_at': '', 'detached_at': '', 'volume_id': '0838d3e5-41a4-4e26-b090-b276de7370ee', 'serial': '0838d3e5-41a4-4e26-b090-b276de7370ee'}, 'delete_on_termination': True, 'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'disk_bus': 'virtio', 'mount_device': '/dev/vda', 'attachment_id': '2bf45dde-f081-4f48-ae80-5c678b9ad00a', 'volume_type': None}], 'swap': None}share_info=None {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:40:40.631891 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported.: NotImplementedError Jun 26 10:40:40.632867 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='volume', root_id='652e47dc-dbeb-4044-a4a6-a03fd1347421', instance_meta=NovaInstanceMeta(name='tempest-ServerActionsV293TestJSON-server-24050431', uuid='3dd6ac52-de12-47da-bc90-77d0fff44acf'), owner=OwnerMeta(userid='11ad63f2d09c4e7dac51c03de3a31f4a', username='tempest-ServerActionsV293TestJSON-1674673586-project-member', projectid='40a4e84471c94128b1ac4dd00ca7177b', projectname='tempest-ServerActionsV293TestJSON-1674673586'), image=ImageMeta(id='', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_rng_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "address": "fa:16:3e:41:2f:75", "network": {"id": "66d12b1b-32f2-4152-b44c-13e5284b49f9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-186021134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a4e84471c94128b1ac4dd00ca7177b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap288e6be4-7a", "ovs_interfaceid": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470440.6324656) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:40:40.635039 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:40:40.635519 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:40:40.637180 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:40:40.637180 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:40:40.638176 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:40:40.638619 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='0c839612eb3f2469420f2ccae990827f',container_format='bare',created_at=2026-06-26T10:34:27Z,direct_url=,disk_format='qcow2',id=652e47dc-dbeb-4044-a4a6-a03fd1347421,min_disk=0,min_ram=0,name='cirros-0.6.1-x86_64-disk',owner='c9ae36cc243a4e18ae07cde67a7b2f3c',properties=ImageMetaProps,protected=,size=21233664,status='active',tags=,updated_at=2026-06-26T10:34:30Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:40:40.638806 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:40:40.638937 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:40:40.639146 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:40:40.639253 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:40:40.639368 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:40:40.639695 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:40:40.639870 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:40:40.639992 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:40:40.640714 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:40:40.640714 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:40:40.641494 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lazy-loading 'vcpu_model' on Instance uuid 3dd6ac52-de12-47da-bc90-77d0fff44acf {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:40.796951 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:40.862380 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.instance_claim" :: held 4.220s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:40.862741 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:40.865227 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: waited 1.763s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:40.960351 np0000003731 nova-compute[98967]: INFO nova.network.neutron [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Updating port 603c0b2c-d13b-48d6-a1a0-77c17c62c23e with attributes {'binding:host_id': 'np0000003731', 'device_owner': 'compute:nova'} Jun 26 10:40:41.154620 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Calling os-brick to attach iSCSI Volume {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:65}} Jun 26 10:40:41.154945 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] ==> connect_volume: call "{'self': , 'connection_properties': {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0838d3e5-41a4-4e26-b090-b276de7370ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:40:41.155166 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:40:41.178656 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [-] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:40:41.283983 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:41.372585 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Require both a host and instance NUMA topology to fit instance on host. {{(pid=98967) numa_fit_instance_to_host /opt/stack/nova/nova/virt/hardware.py:2630}} Jun 26 10:40:41.372770 np0000003731 nova-compute[98967]: INFO nova.compute.claims [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Claim successful on node np0000003731 Jun 26 10:40:41.439688 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:41.440326 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:41.440717 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:41.519087 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "refresh_cache-edf92675-15b4-424f-85b5-80341e77b578" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:40:41.519214 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquired lock "refresh_cache-edf92675-15b4-424f-85b5-80341e77b578" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:40:41.519372 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:40:41.526476 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Port fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df binding to destination host np0000003731 is already ACTIVE {{(pid=98967) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}} Jun 26 10:40:41.526786 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquiring lock "refresh_cache-3a56a898-691e-473e-a5c1-d618e861087b" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:40:41.526907 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquired lock "refresh_cache-3a56a898-691e-473e-a5c1-d618e861087b" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:40:41.527144 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:40:41.603625 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Searching for a device in session 43 and hctl ['10', '*', '*', 0] yield: sde {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:40:41.603849 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Connected to sde using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f109100b-1f3d-418a-9112-045de874c2e6', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:40:41.683040 np0000003731 nova-compute[98967]: INFO nova.compute.manager [-] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Took 4.57 seconds to deallocate network for instance. Jun 26 10:40:41.878055 np0000003731 nova-compute[98967]: INFO nova.compute.resource_tracker [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Updating resource usage from migration 1fbba46c-a3ba-4613-ab2b-045986e3b8cc Jun 26 10:40:42.021355 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:42.029877 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:42.380218 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Found WWN 330000000a9008d4c for multipath device dm-3 {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 26 10:40:42.382883 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.056s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:40:42.382883 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] <== connect_volume: return (3057ms) {'type': 'block', 'scsi_wwn': '330000000a9008d4c', 'path': '/dev/dm-3', 'multipath_id': '330000000a9008d4c'} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:40:42.384109 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000a9008d4c', 'path': '/dev/dm-3', 'multipath_id': '330000000a9008d4c'} {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 26 10:40:42.385916 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 2.395s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:40:42.386377 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065', 'iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f75790bf-71bb-4447-80b7-693d4f5a7065', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 10:40:42.406925 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:40:42.407849 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:40:42.408538 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:40:42.410768 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:40:42.410768 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:40:42.410768 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:40:42.429764 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-5ad0ac49-e98d-45b1-8b63-75d88f0e87ec req-642c5d28-d2c7-4e90-b6cc-251131072457 service nova] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Received event network-vif-deleted-9882d815-8273-4eb8-937b-a1c1e4af4018 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:42.429764 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-5ad0ac49-e98d-45b1-8b63-75d88f0e87ec req-642c5d28-d2c7-4e90-b6cc-251131072457 service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Received event network-changed-603c0b2c-d13b-48d6-a1a0-77c17c62c23e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:42.429906 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-5ad0ac49-e98d-45b1-8b63-75d88f0e87ec req-642c5d28-d2c7-4e90-b6cc-251131072457 service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Refreshing instance network info cache due to event network-changed-603c0b2c-d13b-48d6-a1a0-77c17c62c23e. {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11993}} Jun 26 10:40:42.434220 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5ad0ac49-e98d-45b1-8b63-75d88f0e87ec req-642c5d28-d2c7-4e90-b6cc-251131072457 service nova] Acquiring lock "refresh_cache-edf92675-15b4-424f-85b5-80341e77b578" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:40:42.434220 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:40:42.434220 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:42.441718 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:40:42.441718 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:42.451988 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065] added Jun 26 10:40:42.451988 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:40:42.451988 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:40:42.451988 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:40:42.451988 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:40:42.451988 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:40:42.451988 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:42.452538 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:40:42.452538 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0438(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:40:42.452668 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:40:42.457027 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065] added Jun 26 10:40:42.457027 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:40:42.457027 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:40:42.457027 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:40:42.457027 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:40:42.457027 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:40:42.457027 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:42.457458 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:40:42.457458 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0469(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:40:42.457642 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:40:42.562322 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:42.574425 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:42.669426 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:42.797564 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Updating instance_info_cache with network_info: [{"id": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "address": "fa:16:3e:9c:69:06", "network": {"id": "745fd3f4-1b5b-4135-add5-62d583152edb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1747333964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13f2d75c17e64be5a0a5a2de4aaca2e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f36cb-f5", "ovs_interfaceid": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:40:42.853444 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Updating instance_info_cache with network_info: [{"id": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "address": "fa:16:3e:97:32:1f", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap603c0b2c-d1", "ovs_interfaceid": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:40:42.902865 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2016055428',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-serverbootfromvolumestablerescuetest-server-2016055428',id=25,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea834a26efe148649425d3e02d974ef4',ramdisk_id='',reservation_id='r-22lat6ou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-618712607',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:40:32Z,user_data=None,user_id='72704c563abb412aa2c238092bd55ec4',uuid=7edf2e67-5bc5-420a-8674-997ea5a30152,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b456b506-7aaf-4c28-a7ed-bcbb16898b49", "address": "fa:16:3e:cb:d9:dc", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb456b506-7a", "ovs_interfaceid": "b456b506-7aaf-4c28-a7ed-bcbb16898b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:40:42.903111 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Converting VIF {"id": "b456b506-7aaf-4c28-a7ed-bcbb16898b49", "address": "fa:16:3e:cb:d9:dc", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb456b506-7a", "ovs_interfaceid": "b456b506-7aaf-4c28-a7ed-bcbb16898b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:40:42.903917 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:d9:dc,bridge_name='br-int',has_traffic_filtering=True,id=b456b506-7aaf-4c28-a7ed-bcbb16898b49,network=Network(67c50821-8012-4a48-8c3a-b0cc3d2ddcb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb456b506-7a') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:40:42.904415 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lazy-loading 'pci_devices' on Instance uuid 7edf2e67-5bc5-420a-8674-997ea5a30152 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:43.130644 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:40:43.130884 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:40:43.299630 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Releasing lock "refresh_cache-3a56a898-691e-473e-a5c1-d618e861087b" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:40:43.355706 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Releasing lock "refresh_cache-edf92675-15b4-424f-85b5-80341e77b578" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:40:43.356655 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Creating instance directory {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5221}} Jun 26 10:40:43.357068 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5ad0ac49-e98d-45b1-8b63-75d88f0e87ec req-642c5d28-d2c7-4e90-b6cc-251131072457 service nova] Acquired lock "refresh_cache-edf92675-15b4-424f-85b5-80341e77b578" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:40:43.357374 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-5ad0ac49-e98d-45b1-8b63-75d88f0e87ec req-642c5d28-d2c7-4e90-b6cc-251131072457 service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Refreshing network info cache for port 603c0b2c-d13b-48d6-a1a0-77c17c62c23e {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2046}} Jun 26 10:40:43.358568 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Creating image(s) Jun 26 10:40:43.359267 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "/opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578/disk.info" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:43.359519 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "/opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578/disk.info" acquired by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:43.360263 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "/opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578/disk.info" "released" by "nova.virt.libvirt.imagebackend.Image.resolve_driver_format..write_to_disk_info_file" :: held 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:43.360487 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lazy-loading 'trusted_certs' on Instance uuid edf92675-15b4-424f-85b5-80341e77b578 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] End _get_guest_xml xml= Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: 7edf2e67-5bc5-420a-8674-997ea5a30152 Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: instance-00000019 Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: 196608 Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: tempest-ServerBootFromVolumeStableRescueTest-server-2016055428 Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: 2026-06-26 10:40:39 Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: 192 Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: 0 Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: 0 Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: True Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: bare Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: 0 Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: virtio Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: tempest-ServerBootFromVolumeStableRescueTest-618712607 Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: 7edf2e67-5bc5-420a-8674-997ea5a30152 Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: 7edf2e67-5bc5-420a-8674-997ea5a30152 Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: hvm Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: 128 Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: f109100b-1f3d-418a-9112-045de874c2e6 Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: Jun 26 10:40:43.407622 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:40:43.414170 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Preparing to wait for external event network-vif-plugged-b456b506-7aaf-4c28-a7ed-bcbb16898b49 {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:40:43.414170 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "7edf2e67-5bc5-420a-8674-997ea5a30152-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:43.414170 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "7edf2e67-5bc5-420a-8674-997ea5a30152-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:43.414170 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "7edf2e67-5bc5-420a-8674-997ea5a30152-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:43.414170 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='',created_at=2026-06-26T10:40:25Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=None,disable_terminate=False,display_description=None,display_name='tempest-ServerBootFromVolumeStableRescueTest-server-2016055428',ec2_ids=EC2Ids,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-serverbootfromvolumestablerescuetest-server-2016055428',id=25,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name=None,keypairs=KeyPairList,launch_index=0,launched_at=None,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=0,progress=0,project_id='ea834a26efe148649425d3e02d974ef4',ramdisk_id='',reservation_id='r-22lat6ou',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',network_allocated='True',owner_project_name='tempest-ServerBootFromVolumeStableRescueTest-618712607',owner_user_name='tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member'},tags=TagList,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:40:32Z,user_data=None,user_id='72704c563abb412aa2c238092bd55ec4',uuid=7edf2e67-5bc5-420a-8674-997ea5a30152,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='building') vif={"id": "b456b506-7aaf-4c28-a7ed-bcbb16898b49", "address": "fa:16:3e:cb:d9:dc", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb456b506-7a", "ovs_interfaceid": "b456b506-7aaf-4c28-a7ed-bcbb16898b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:40:43.414170 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Converting VIF {"id": "b456b506-7aaf-4c28-a7ed-bcbb16898b49", "address": "fa:16:3e:cb:d9:dc", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb456b506-7a", "ovs_interfaceid": "b456b506-7aaf-4c28-a7ed-bcbb16898b49", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:40:43.414170 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:cb:d9:dc,bridge_name='br-int',has_traffic_filtering=True,id=b456b506-7aaf-4c28-a7ed-bcbb16898b49,network=Network(67c50821-8012-4a48-8c3a-b0cc3d2ddcb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb456b506-7a') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:40:43.414170 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:d9:dc,bridge_name='br-int',has_traffic_filtering=True,id=b456b506-7aaf-4c28-a7ed-bcbb16898b49,network=Network(67c50821-8012-4a48-8c3a-b0cc3d2ddcb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb456b506-7a') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:40:43.414170 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:43.414170 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:43.414170 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:40:43.414170 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:43.414170 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '23f8a3de-955a-5274-85f4-7f9acf3f94ca', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:43.416030 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:43.416030 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:43.416711 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:43.420277 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:43.421978 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tapb456b506-7a, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:43.421978 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tapb456b506-7a, col_values=(('qos', UUID('50855fc5-fcaf-4d1a-93f7-7600fc1abdd6')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:43.421978 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tapb456b506-7a, col_values=(('external_ids', {'iface-id': 'b456b506-7aaf-4c28-a7ed-bcbb16898b49', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:cb:d9:dc', 'vm-uuid': '7edf2e67-5bc5-420a-8674-997ea5a30152'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:43.424222 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:43.424222 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:43.430142 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:43.432155 np0000003731 nova-compute[98967]: INFO os_vif [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:cb:d9:dc,bridge_name='br-int',has_traffic_filtering=True,id=b456b506-7aaf-4c28-a7ed-bcbb16898b49,network=Network(67c50821-8012-4a48-8c3a-b0cc3d2ddcb6),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb456b506-7a') Jun 26 10:40:43.433998 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Took 1.75 seconds to detach 3 volumes for instance. Jun 26 10:40:43.453154 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:40:43.458261 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.40.100 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:40:43.469863 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.50.100 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:40:43.485647 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:43.495079 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:43.505606 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:43.519599 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:43.519599 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:43.519599 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:43.519599 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:43.519599 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:43.519599 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:43.519599 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:43.519599 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:43.519599 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:43.519599 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:43.519599 np0000003731 nova-compute[98967]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:43.519599 np0000003731 nova-compute[98967]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:43.519599 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:40:43.520055 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:43.520055 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:43.520055 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:43.520055 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:43.520055 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:43.520055 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:43.520055 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:43.520055 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:43.520055 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:43.520055 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:43.520055 np0000003731 nova-compute[98967]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:43.520055 np0000003731 nova-compute[98967]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:43.520055 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:40:43.528388 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:43.528388 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:43.528388 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:43.528388 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:43.528388 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:43.528388 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:43.528388 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:43.528388 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:43.528388 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:43.528388 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:43.528388 np0000003731 nova-compute[98967]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:43.528388 np0000003731 nova-compute[98967]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:43.528388 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:40:43.528755 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:43.528755 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:43.528755 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:43.528755 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:43.528755 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:43.528755 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:43.528755 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:43.528755 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:43.528755 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:43.528755 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:43.528755 np0000003731 nova-compute[98967]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:43.528755 np0000003731 nova-compute[98967]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:43.528755 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:40:43.580709 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065, portal: 192.168.40.100,3260] Jun 26 10:40:43.580709 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065, portal: 192.168.40.100,3260] successful. Jun 26 10:40:43.580709 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:43.599812 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:43.613035 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065, portal: 192.168.50.100,3260] Jun 26 10:40:43.613035 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065, portal: 192.168.50.100,3260] successful. Jun 26 10:40:43.613035 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:43.623544 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:43.623544 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:43.623544 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:43.623544 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:43.623544 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:43.623544 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:43.623544 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:43.623544 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:43.623544 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:43.623544 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:43.623544 np0000003731 nova-compute[98967]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:43.623544 np0000003731 nova-compute[98967]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:43.623544 np0000003731 nova-compute[98967]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:43.623544 np0000003731 nova-compute[98967]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:43.623544 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:40:43.624130 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:43.624130 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:43.624130 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:43.624130 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:43.624130 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:43.624130 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:43.624130 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:43.624130 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:43.624130 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:43.624130 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:43.624130 np0000003731 nova-compute[98967]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:43.624130 np0000003731 nova-compute[98967]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:43.624130 np0000003731 nova-compute[98967]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:43.624130 np0000003731 nova-compute[98967]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:43.624130 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:40:43.624130 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.216s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:40:43.624792 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Connected to 192.168.40.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:40:43.625920 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:43.627616 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] HCTL ('11', '-', '-', 0) found on session 44 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:40:43.627812 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Scanning host 11 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:40:43.633706 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:40:43.648593 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Searching for a device in session 44 and hctl ['11', '*', '*', 0] yield: sdf {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:40:43.648795 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Connected to sdf using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f75790bf-71bb-4447-80b7-693d4f5a7065', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:40:43.649293 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:43.649293 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:43.649293 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:43.649293 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:43.649293 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:43.649293 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:43.649293 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:43.649293 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:43.649293 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:43.649293 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:43.649293 np0000003731 nova-compute[98967]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:43.649293 np0000003731 nova-compute[98967]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:43.649293 np0000003731 nova-compute[98967]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:43.649293 np0000003731 nova-compute[98967]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:43.649293 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:40:43.649702 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:43.649702 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:43.649702 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:43.649702 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:43.649702 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:43.649702 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:43.649702 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:43.649702 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:43.649702 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:43.649702 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:43.649702 np0000003731 nova-compute[98967]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:43.649702 np0000003731 nova-compute[98967]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:43.649702 np0000003731 nova-compute[98967]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:43.649702 np0000003731 nova-compute[98967]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:43.649702 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:40:43.650090 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.240s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:40:43.650090 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Connected to 192.168.50.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:40:43.652733 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] HCTL ('12', '-', '-', 0) found on session 45 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:40:43.652733 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Scanning host 12 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:40:43.674962 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Searching for a device in session 45 and hctl ['12', '*', '*', 0] yield: sdg {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:40:43.675064 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Connected to sdg using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': 'f75790bf-71bb-4447-80b7-693d4f5a7065', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:40:43.804116 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Creating tmpfile /opt/stack/data/nova/instances/3a56a898-691e-473e-a5c1-d618e861087b/tmpo80tsjlx to verify with other compute node that the instance is on the same shared storage. {{(pid=98967) check_instance_shared_storage_local /opt/stack/nova/nova/virt/libvirt/driver.py:10568}} Jun 26 10:40:43.804116 np0000003731 nova-compute[98967]: DEBUG nova.compute.rpcapi [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98967) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 26 10:40:43.862725 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-5ad0ac49-e98d-45b1-8b63-75d88f0e87ec req-642c5d28-d2c7-4e90-b6cc-251131072457 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:43.865746 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Object Instance lazy-loaded attributes: pci_requests,trusted_certs {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:40:43.867031 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "037a13684297b4bf7b4d5fb3787dc6e312bbe144" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:43.867763 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "037a13684297b4bf7b4d5fb3787dc6e312bbe144" acquired by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:43.941628 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.update_usage" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:44.143360 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.resize_claim" :: held 3.278s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:44.143706 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Migrating Jun 26 10:40:44.143972 np0000003731 nova-compute[98967]: DEBUG nova.compute.rpcapi [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98967) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 26 10:40:44.149681 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: waited 0.208s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:44.255433 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [req-5ad0ac49-e98d-45b1-8b63-75d88f0e87ec req-642c5d28-d2c7-4e90-b6cc-251131072457 service nova] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:44.340610 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:44.345615 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:44.369551 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:44.378950 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:44.407325 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "c8aff61a-5f59-4f8c-8288-abd5a7853474" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:44.407544 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:44.411346 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 26 10:40:44.412248 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:44.413377 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:44.467112 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-5ad0ac49-e98d-45b1-8b63-75d88f0e87ec req-642c5d28-d2c7-4e90-b6cc-251131072457 service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Updated VIF entry in instance network info cache for port 603c0b2c-d13b-48d6-a1a0-77c17c62c23e. {{(pid=98967) _build_network_info_model /opt/stack/nova/nova/network/neutron.py:3523}} Jun 26 10:40:44.467112 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [req-5ad0ac49-e98d-45b1-8b63-75d88f0e87ec req-642c5d28-d2c7-4e90-b6cc-251131072457 service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Updating instance_info_cache with network_info: [{"id": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "address": "fa:16:3e:97:32:1f", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap603c0b2c-d1", "ovs_interfaceid": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:40:44.553110 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-12205dca-de2a-4f57-9c94-93c541a677de req-5e592253-9cb7-4880-ac84-4700421a1c0e service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Received event network-vif-unplugged-fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:44.555695 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-12205dca-de2a-4f57-9c94-93c541a677de req-5e592253-9cb7-4880-ac84-4700421a1c0e service nova] Acquiring lock "3a56a898-691e-473e-a5c1-d618e861087b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:44.555931 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-12205dca-de2a-4f57-9c94-93c541a677de req-5e592253-9cb7-4880-ac84-4700421a1c0e service nova] Lock "3a56a898-691e-473e-a5c1-d618e861087b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:44.556150 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-12205dca-de2a-4f57-9c94-93c541a677de req-5e592253-9cb7-4880-ac84-4700421a1c0e service nova] Lock "3a56a898-691e-473e-a5c1-d618e861087b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:44.556349 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-12205dca-de2a-4f57-9c94-93c541a677de req-5e592253-9cb7-4880-ac84-4700421a1c0e service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] No waiting events found dispatching network-vif-unplugged-fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:44.557785 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-12205dca-de2a-4f57-9c94-93c541a677de req-5e592253-9cb7-4880-ac84-4700421a1c0e service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Received unexpected event network-vif-unplugged-fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df for instance with vm_state resized and task_state resize_reverting. Jun 26 10:40:44.661928 np0000003731 nova-compute[98967]: DEBUG nova.utils [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Queued Task(fn=>, remaining_delay=14.999646857000016 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:44.664685 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Instance destroyed successfully. Jun 26 10:40:44.665538 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lazy-loading 'resources' on Instance uuid 3a56a898-691e-473e-a5c1-d618e861087b {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:44.682040 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "refresh_cache-f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:40:44.682688 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquired lock "refresh_cache-f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:40:44.682928 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:40:44.876267 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'QFI\xfb') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:40:44.880223 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:40:44.880720 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/037a13684297b4bf7b4d5fb3787dc6e312bbe144.part --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:44.914936 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Detaching volume bcbe644e-6829-4ba9-8208-ed82c54853b2 Jun 26 10:40:44.965185 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:40:44.965185 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:40:44.965185 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] No VIF found with MAC fa:16:3e:cb:d9:dc, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:40:44.965185 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Using config drive Jun 26 10:40:44.972567 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5ad0ac49-e98d-45b1-8b63-75d88f0e87ec req-642c5d28-d2c7-4e90-b6cc-251131072457 service nova] Releasing lock "refresh_cache-edf92675-15b4-424f-85b5-80341e77b578" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:40:44.979158 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/037a13684297b4bf7b4d5fb3787dc6e312bbe144.part --force-share --output=json" returned: 0 in 0.098s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:44.980135 np0000003731 nova-compute[98967]: DEBUG nova.virt.images [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] 6e289f27-47a0-43f7-a307-065de0dfc62a was qcow2, converting to raw {{(pid=98967) fetch_to_raw /opt/stack/nova/nova/virt/images.py:278}} Jun 26 10:40:44.981496 np0000003731 nova-compute[98967]: DEBUG nova.privsep.utils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Path '/opt/stack/data/nova/instances' supports direct I/O {{(pid=98967) supports_direct_io /opt/stack/nova/nova/privsep/utils.py:63}} Jun 26 10:40:44.982699 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/037a13684297b4bf7b4d5fb3787dc6e312bbe144.part /opt/stack/data/nova/instances/_base/037a13684297b4bf7b4d5fb3787dc6e312bbe144.converted {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:45.011364 np0000003731 nova-compute[98967]: INFO nova.virt.block_device [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Attempting to driver detach volume bcbe644e-6829-4ba9-8208-ed82c54853b2 from mountpoint /dev/vdb Jun 26 10:40:45.020490 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Found disk vdb by alias ua-bcbe644e-6829-4ba9-8208-ed82c54853b2 {{(pid=98967) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 26 10:40:45.022218 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Found disk vdb by alias ua-bcbe644e-6829-4ba9-8208-ed82c54853b2 {{(pid=98967) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 26 10:40:45.022395 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Attempting to detach device vdb from instance c8aff61a-5f59-4f8c-8288-abd5a7853474 from the persistent domain config. {{(pid=98967) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 26 10:40:45.023110 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] detach device xml: Jun 26 10:40:45.023110 np0000003731 nova-compute[98967]: Jun 26 10:40:45.023110 np0000003731 nova-compute[98967]: Jun 26 10:40:45.023110 np0000003731 nova-compute[98967]: Jun 26 10:40:45.023110 np0000003731 nova-compute[98967]: Jun 26 10:40:45.023110 np0000003731 nova-compute[98967]: bcbe644e-6829-4ba9-8208-ed82c54853b2 Jun 26 10:40:45.023110 np0000003731 nova-compute[98967]:
Jun 26 10:40:45.023110 np0000003731 nova-compute[98967]: Jun 26 10:40:45.023110 np0000003731 nova-compute[98967]: {{(pid=98967) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 26 10:40:45.034294 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Successfully detached device vdb from instance c8aff61a-5f59-4f8c-8288-abd5a7853474 from the persistent domain config. Jun 26 10:40:45.034682 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] (1/8): Attempting to detach device vdb with device alias ua-bcbe644e-6829-4ba9-8208-ed82c54853b2 from instance c8aff61a-5f59-4f8c-8288-abd5a7853474 from the live domain config. {{(pid=98967) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 26 10:40:45.034952 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] detach device xml: Jun 26 10:40:45.034952 np0000003731 nova-compute[98967]: Jun 26 10:40:45.034952 np0000003731 nova-compute[98967]: Jun 26 10:40:45.034952 np0000003731 nova-compute[98967]: Jun 26 10:40:45.034952 np0000003731 nova-compute[98967]: Jun 26 10:40:45.034952 np0000003731 nova-compute[98967]: bcbe644e-6829-4ba9-8208-ed82c54853b2 Jun 26 10:40:45.034952 np0000003731 nova-compute[98967]:
Jun 26 10:40:45.034952 np0000003731 nova-compute[98967]: Jun 26 10:40:45.034952 np0000003731 nova-compute[98967]: {{(pid=98967) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 26 10:40:45.169050 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:57Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerActionsTestOtherB-server-189933630',display_name='tempest-ServerActionsTestOtherB-server-189933630',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(12),hidden=False,host='np0000003731',hostname='tempest-serveractionstestotherb-server-189933630',id=19,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=12,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDv+GLIZEgqCpG9Ar7Sy1trgWnL3YEyqFHnBU/WG9g4CSqyvLBbCulNghiyJn3KpB/3bSNsGv+SgxNXmmFNVCZyLb+bs7KEXcLVodWAftMPleXJm0MjBQWdyVYaPKr8FFQ==',key_name='tempest-keypair-1436363432',keypairs=,launch_index=0,launched_at=2026-06-26T10:40:39Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=256,metadata={},migration_context=,new_flavor=Flavor(12),node='np0000003731',numa_topology=None,old_flavor=Flavor(11),os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='13f2d75c17e64be5a0a5a2de4aaca2e7',ramdisk_id='',reservation_id='r-y898iga0',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-ServerActionsTestOtherB-576427951',owner_user_name='tempest-ServerActionsTestOtherB-576427951-project-member'},tags=,task_state='resize_reverting',terminated_at=None,trusted_certs=,updated_at=2026-06-26T10:40:40Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='3d2ca60f7c4f4cb5a413138ae1f040a7',uuid=3a56a898-691e-473e-a5c1-d618e861087b,vcpu_model=,vcpus=1,vm_mode=None,vm_state='resized') vif={"id": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "address": "fa:16:3e:9c:69:06", "network": {"id": "745fd3f4-1b5b-4135-add5-62d583152edb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1747333964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13f2d75c17e64be5a0a5a2de4aaca2e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f36cb-f5", "ovs_interfaceid": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 26 10:40:45.169342 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Converting VIF {"id": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "address": "fa:16:3e:9c:69:06", "network": {"id": "745fd3f4-1b5b-4135-add5-62d583152edb", "bridge": "br-int", "label": "tempest-ServerActionsTestOtherB-1747333964-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.209", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "13f2d75c17e64be5a0a5a2de4aaca2e7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapfd2f36cb-f5", "ovs_interfaceid": "fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:40:45.170473 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:9c:69:06,bridge_name='br-int',has_traffic_filtering=True,id=fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df,network=Network(745fd3f4-1b5b-4135-add5-62d583152edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd2f36cb-f5') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:40:45.170922 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:69:06,bridge_name='br-int',has_traffic_filtering=True,id=fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df,network=Network(745fd3f4-1b5b-4135-add5-62d583152edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd2f36cb-f5') {{(pid=98967) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 26 10:40:45.173232 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:45.173734 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapfd2f36cb-f5, bridge=br-int, if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:45.178286 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:45.179302 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:45.185340 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:45.188463 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:45.188885 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=b7402c81-f691-48e8-9a13-a48887d24474) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:45.189431 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:45.189993 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:45.193472 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:45.199918 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:45.203955 np0000003731 nova-compute[98967]: INFO os_vif [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:9c:69:06,bridge_name='br-int',has_traffic_filtering=True,id=fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df,network=Network(745fd3f4-1b5b-4135-add5-62d583152edb),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapfd2f36cb-f5') Jun 26 10:40:45.206074 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] calling os-brick to detach iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 26 10:40:45.206544 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, None), 'kwargs': {'force': True}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:40:45.207706 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:40:45.214770 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "qemu-img convert -t none -O raw -f qcow2 /opt/stack/data/nova/instances/_base/037a13684297b4bf7b4d5fb3787dc6e312bbe144.part /opt/stack/data/nova/instances/_base/037a13684297b4bf7b4d5fb3787dc6e312bbe144.converted" returned: 0 in 0.232s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:45.231548 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/037a13684297b4bf7b4d5fb3787dc6e312bbe144.converted --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:45.340180 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/037a13684297b4bf7b4d5fb3787dc6e312bbe144.converted --force-share --output=json" returned: 0 in 0.108s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:45.342162 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "037a13684297b4bf7b4d5fb3787dc6e312bbe144" "released" by "nova.virt.libvirt.imagebackend.Image.cache..fetch_func_sync" :: held 1.474s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:45.343263 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:40:45.349904 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:40:45.355089 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/037a13684297b4bf7b4d5fb3787dc6e312bbe144 --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:45.430795 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Found WWN 330000000e630844d for multipath device dm-6 {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 26 10:40:45.430795 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.044s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:40:45.430795 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] <== connect_volume: return (5438ms) {'type': 'block', 'scsi_wwn': '330000000e630844d', 'path': '/dev/dm-6', 'multipath_id': '330000000e630844d'} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:40:45.430795 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '330000000e630844d', 'path': '/dev/dm-6', 'multipath_id': '330000000e630844d'} {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 26 10:40:45.431311 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: waited 4.276s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:40:45.431686 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Connection properties {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0838d3e5-41a4-4e26-b090-b276de7370ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) check_multipath /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:132}} Jun 26 10:40:45.434817 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lazy-loading 'flavor' on Instance uuid 619d915a-12c9-424f-8c12-b2a3f94a4109 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:45.452490 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:40:45.454226 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.002s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:40:45.454576 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:40:45.455910 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Acquiring lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:40:45.458588 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/037a13684297b4bf7b4d5fb3787dc6e312bbe144 --force-share --output=json" returned: 0 in 0.103s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:45.458728 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: waited 0.003s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:40:45.461463 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:40:45.461463 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "037a13684297b4bf7b4d5fb3787dc6e312bbe144" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:45.461463 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "037a13684297b4bf7b4d5fb3787dc6e312bbe144" acquired by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:45.462863 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Format inspector for vmdk does not match, excluding from consideration (Signature KDMV not found: b'\xebH\x90\x00') {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:40:45.469767 np0000003731 nova-compute[98967]: DEBUG oslo_utils.imageutils.format_inspector [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Format inspector for vhdx does not match, excluding from consideration (Region signature not found at 30000) {{(pid=98967) _process_chunk /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/imageutils/format_inspector.py:1758}} Jun 26 10:40:45.470186 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/037a13684297b4bf7b4d5fb3787dc6e312bbe144 --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:45.519906 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:45.524806 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:40:45.524806 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:45.526483 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm (): stdout= stderr=iscsiadm: No records found Jun 26 10:40:45.526483 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:45.541603 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.40.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee] added Jun 26 10:40:45.541603 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:40:45.541603 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:40:45.541603 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:40:45.541603 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:40:45.541603 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:40:45.541603 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:45.544211 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('--interface', 'default', '--op', 'new'): stdout=New iSCSI node [tcp:[hw=,ip=,net_if=,iscsi_if=default] 192.168.50.100,3260,-1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee] added Jun 26 10:40:45.544211 np0000003731 nova-compute[98967]: stderr=iscsiadm: Config file line 363 does not have value Jun 26 10:40:45.544211 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:40:45.544211 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:40:45.544211 np0000003731 nova-compute[98967]: iscsiadm: Config file line 363 does not have value Jun 26 10:40:45.544211 np0000003731 nova-compute[98967]: iscsiadm: Ignoring unknown value 'SHA3-256' for 'node.session.auth.chap_algs' Jun 26 10:40:45.544211 np0000003731 nova-compute[98967]: {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:45.544550 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Retrying to connect to iSCSI portal 192.168.40.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:40:45.545132 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Retrying to connect to iSCSI portal 192.168.50.100:3260 {{(pid=98967) _connect_to_iscsi_portal_unsafe /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1157}} Jun 26 10:40:45.545482 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0903(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:40:45.545800 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Finished call to 'os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe' after 0.0864(s), this was the 1st time calling it. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/after.py:42}} Jun 26 10:40:45.545965 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:40:45.546146 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Retrying os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe in 1 seconds as it raised BrickException: An unknown exception occurred.. {{(pid=98967) log_it /opt/stack/data/venv/lib/python3.12/site-packages/tenacity/before_sleep.py:64}} Jun 26 10:40:45.551282 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:40:45.551840 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:40:45.585140 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/037a13684297b4bf7b4d5fb3787dc6e312bbe144 --force-share --output=json" returned: 0 in 0.115s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:45.587818 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/037a13684297b4bf7b4d5fb3787dc6e312bbe144,backing_fmt=raw /opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578/disk 1073741824 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:45.666971 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "env LC_ALL=C LANG=C qemu-img create -f qcow2 -o backing_file=/opt/stack/data/nova/instances/_base/037a13684297b4bf7b4d5fb3787dc6e312bbe144,backing_fmt=raw /opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578/disk 1073741824" returned: 0 in 0.079s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:45.667178 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "037a13684297b4bf7b4d5fb3787dc6e312bbe144" "released" by "nova.virt.libvirt.imagebackend.Qcow2.create_image..create_qcow2_image" :: held 0.207s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:45.667466 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/037a13684297b4bf7b4d5fb3787dc6e312bbe144 --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:45.689332 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Received event ua-bcbe644e-6829-4ba9-8208-ed82c54853b2> from libvirt while the driver is waiting for it; dispatched. {{(pid=98967) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 26 10:40:45.689846 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-bcbe644e-6829-4ba9-8208-ed82c54853b2 for instance c8aff61a-5f59-4f8c-8288-abd5a7853474 {{(pid=98967) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 26 10:40:45.701929 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Creating config drive at /opt/stack/data/nova/instances/7edf2e67-5bc5-420a-8674-997ea5a30152/disk.config Jun 26 10:40:45.709876 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Successfully detached device vdb from instance c8aff61a-5f59-4f8c-8288-abd5a7853474 from the live domain config. Jun 26 10:40:45.714146 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] calling os-brick to detach iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 26 10:40:45.714632 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2', 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcbe644e-6829-4ba9-8208-ed82c54853b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-13'}, None), 'kwargs': {'force': False}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:40:45.714809 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:40:45.715815 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/7edf2e67-5bc5-420a-8674-997ea5a30152/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuffttean {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:45.768445 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/7edf2e67-5bc5-420a-8674-997ea5a30152/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpuffttean" returned: 0 in 0.052s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:45.772125 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:45.774378 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/037a13684297b4bf7b4d5fb3787dc6e312bbe144 --force-share --output=json" returned: 0 in 0.107s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:45.774838 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lazy-loading 'migration_context' on Instance uuid edf92675-15b4-424f-85b5-80341e77b578 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:45.930184 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Updating instance_info_cache with network_info: [{"id": "b747180c-b090-4936-90bc-0c6553817170", "address": "fa:16:3e:43:d8:28", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb747180c-b0", "ovs_interfaceid": "b747180c-b090-4936-90bc-0c6553817170", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:40:45.939209 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Attempting to attach volume f75790bf-71bb-4447-80b7-693d4f5a7065 with discard support enabled to an instance using an unsupported configuration. target_bus = virtio. Trim commands will not be issued to the storage device. {{(pid=98967) _check_discard_for_attach_volume /opt/stack/nova/nova/virt/libvirt/driver.py:2320}} Jun 26 10:40:45.942059 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] attach device xml: Jun 26 10:40:45.942059 np0000003731 nova-compute[98967]: Jun 26 10:40:45.942059 np0000003731 nova-compute[98967]: Jun 26 10:40:45.942059 np0000003731 nova-compute[98967]: Jun 26 10:40:45.942059 np0000003731 nova-compute[98967]: Jun 26 10:40:45.942059 np0000003731 nova-compute[98967]: f75790bf-71bb-4447-80b7-693d4f5a7065 Jun 26 10:40:45.942059 np0000003731 nova-compute[98967]: Jun 26 10:40:45.942059 np0000003731 nova-compute[98967]: {{(pid=98967) attach_device /opt/stack/nova/nova/virt/libvirt/guest.py:351}} Jun 26 10:40:46.056381 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:40:46.277779 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Object Instance lazy-loaded attributes: pci_requests,trusted_certs,migration_context {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:40:46.278211 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Rebasing disk image. Jun 26 10:40:46.278528 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:46.373688 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:46.386561 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe --force-share --output=json" returned: 0 in 0.107s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:46.386561 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): qemu-img rebase -b /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe -F raw /opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578/disk {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:46.409177 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:46.435868 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Releasing lock "refresh_cache-f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:40:46.522465 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:46.546847 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Trying to connect to iSCSI portal 192.168.50.100:3260 Jun 26 10:40:46.551077 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Trying to connect to iSCSI portal 192.168.40.100:3260 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.50.100 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:40:46.565033 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:46.570037 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.update_usage" :: held 2.420s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm (): stdout=# BEGIN RECORD 2.1.9 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.name = iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.tpgt = -1 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.startup = manual Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.leading_login = No Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.iscsi_ifacename = default Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.net_ifacename = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.ipaddress = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.prefix_len = 0 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.hwaddress = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.transport_name = tcp Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.initiatorname = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.state = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.vlan_id = 0 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.vlan_priority = 0 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.vlan_state = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.iface_num = 0 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.mtu = 0 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.port = 0 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.bootproto = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.subnet_mask = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.gateway = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id_state = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.dhcp_alt_client_id = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.dhcp_dns = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.dhcp_learn_iqn = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.dhcp_req_vendor_id_state = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id_state = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.dhcp_vendor_id = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.dhcp_slp_da = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.fragmentation = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.gratuitous_arp = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.incoming_forwarding = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.tos_state = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.tos = 0 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.ttl = 0 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.delayed_ack = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.tcp_nagle = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.tcp_wsf_state = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.tcp_wsf = 0 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.tcp_timer_scale = 0 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.tcp_timestamp = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.redirect = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.def_task_mgmt_timeout = 0 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.header_digest = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.data_digest = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.immediate_data = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.initial_r2t = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.data_seq_inorder = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.data_pdu_inorder = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.erl = 0 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.max_receive_data_len = 0 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.first_burst_len = 0 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.max_outstanding_r2t = 0 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.max_burst_len = 0 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.chap_auth = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.bidi_chap = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.strict_login_compliance = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.discovery_auth = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: iface.discovery_logout = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.discovery_address = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.discovery_port = 0 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.discovery_type = fw Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.session.initial_cmdsn = 0 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.session.initial_login_retry_max = 8 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.session.xmit_thread_priority = 0 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.session.cmds_max = 128 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.session.queue_depth = 32 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.session.nr_sessions = 1 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.session.auth.authmethod = None Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.session.auth.username = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.session.auth.password = *** Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.session.auth.username_in = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.session.auth.password_in = Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.session.auth.chap_algs = SHA256 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.session.timeo.replacement_timeout = 120 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.session.err_timeo.abort_timeout = 15 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.session.err_timeo.lu_reset_timeout = 30 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.session.err_timeo.tgt_reset_timeout = 30 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.session.err_timeo.host_reset_timeout = 60 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.session.iscsi.FastAbort = Yes Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.session.iscsi.InitialR2T = No Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.session.iscsi.ImmediateData = Yes Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.session.iscsi.FirstBurstLength = 262144 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.session.iscsi.MaxBurstLength = 16776192 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Retain = 0 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.session.iscsi.DefaultTime2Wait = 2 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.session.iscsi.MaxConnections = 1 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.session.iscsi.MaxOutstandingR2T = 1 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.session.iscsi.ERL = 0 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.session.scan = auto Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.session.reopen_max = 0 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.conn[0].address = 192.168.40.100 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.conn[0].port = 3260 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.conn[0].startup = manual Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.conn[0].tcp.window_size = 524288 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.conn[0].tcp.type_of_service = 0 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.conn[0].timeo.logout_timeout = 15 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.conn[0].timeo.login_timeout = 15 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.conn[0].timeo.auth_timeout = 45 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_interval = 5 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.conn[0].timeo.noop_out_timeout = 5 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxXmitDataSegmentLength = 0 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.conn[0].iscsi.MaxRecvDataSegmentLength = 262144 Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.conn[0].iscsi.HeaderDigest = None Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.conn[0].iscsi.DataDigest = None Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.conn[0].iscsi.IFMarker = No Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: node.conn[0].iscsi.OFMarker = No Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: # END RECORD Jun 26 10:40:46.574420 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:46.582555 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:46.590041 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:46.591837 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('--op', 'update', '-n', 'node.session.scan', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:46.596465 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:46.610962 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:46.610962 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:46.610962 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:46.610962 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:46.610962 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:46.610962 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:46.610962 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:46.610962 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:46.610962 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:46.610962 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:46.610962 np0000003731 nova-compute[98967]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:46.610962 np0000003731 nova-compute[98967]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:46.610962 np0000003731 nova-compute[98967]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:46.610962 np0000003731 nova-compute[98967]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:46.610962 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:40:46.611844 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:46.611844 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:46.611844 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:46.611844 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:46.611844 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:46.611844 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:46.611844 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:46.611844 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:46.611844 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:46.611844 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:46.611844 np0000003731 nova-compute[98967]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:46.611844 np0000003731 nova-compute[98967]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:46.611844 np0000003731 nova-compute[98967]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:46.611844 np0000003731 nova-compute[98967]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:46.611844 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:40:46.619301 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:46.619301 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:46.619301 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:46.619301 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:46.619301 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:46.619301 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:46.619301 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:46.619301 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:46.619301 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:46.619301 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:46.619301 np0000003731 nova-compute[98967]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:46.619301 np0000003731 nova-compute[98967]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:46.619301 np0000003731 nova-compute[98967]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:46.619301 np0000003731 nova-compute[98967]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:46.619301 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:40:46.620330 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:46.620330 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:46.620330 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:46.620330 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:46.620330 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:46.620330 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:46.620330 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:46.620330 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:46.620330 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:46.620330 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:46.620330 np0000003731 nova-compute[98967]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:46.620330 np0000003731 nova-compute[98967]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:46.620330 np0000003731 nova-compute[98967]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:46.620330 np0000003731 nova-compute[98967]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:46.620330 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:40:46.655797 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-19615311-ff48-485f-9d4e-e1324bc78603 req-ce220f11-9215-4f79-b909-eb74ff58b099 service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Received event network-vif-unplugged-fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:46.655797 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-19615311-ff48-485f-9d4e-e1324bc78603 req-ce220f11-9215-4f79-b909-eb74ff58b099 service nova] Acquiring lock "3a56a898-691e-473e-a5c1-d618e861087b-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:46.655797 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-19615311-ff48-485f-9d4e-e1324bc78603 req-ce220f11-9215-4f79-b909-eb74ff58b099 service nova] Lock "3a56a898-691e-473e-a5c1-d618e861087b-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:46.655797 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-19615311-ff48-485f-9d4e-e1324bc78603 req-ce220f11-9215-4f79-b909-eb74ff58b099 service nova] Lock "3a56a898-691e-473e-a5c1-d618e861087b-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:46.655797 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-19615311-ff48-485f-9d4e-e1324bc78603 req-ce220f11-9215-4f79-b909-eb74ff58b099 service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] No waiting events found dispatching network-vif-unplugged-fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:46.655797 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-19615311-ff48-485f-9d4e-e1324bc78603 req-ce220f11-9215-4f79-b909-eb74ff58b099 service nova] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Received unexpected event network-vif-unplugged-fd2f36cb-f5f5-4fd4-944c-1a2521a0f1df for instance with vm_state resized and task_state resize_reverting. Jun 26 10:40:46.668271 np0000003731 nova-compute[98967]: INFO nova.scheduler.client.report [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Deleted allocations for instance ee4d14ad-8bd2-4b8b-9526-51abafe757f2 Jun 26 10:40:46.681818 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee, portal: 192.168.50.100,3260] Jun 26 10:40:46.681818 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee, portal: 192.168.50.100,3260] successful. Jun 26 10:40:46.681818 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:46.688188 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-1d6f5d56-2aef-4042-b956-fe5b2fc0f63d req-8394393f-00e0-485d-8cf0-4de92ff9c564 service nova] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Received event network-vif-plugged-b456b506-7aaf-4c28-a7ed-bcbb16898b49 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:46.688376 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-1d6f5d56-2aef-4042-b956-fe5b2fc0f63d req-8394393f-00e0-485d-8cf0-4de92ff9c564 service nova] Acquiring lock "7edf2e67-5bc5-420a-8674-997ea5a30152-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:46.689132 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-1d6f5d56-2aef-4042-b956-fe5b2fc0f63d req-8394393f-00e0-485d-8cf0-4de92ff9c564 service nova] Lock "7edf2e67-5bc5-420a-8674-997ea5a30152-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:46.689912 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-1d6f5d56-2aef-4042-b956-fe5b2fc0f63d req-8394393f-00e0-485d-8cf0-4de92ff9c564 service nova] Lock "7edf2e67-5bc5-420a-8674-997ea5a30152-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:46.689912 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-1d6f5d56-2aef-4042-b956-fe5b2fc0f63d req-8394393f-00e0-485d-8cf0-4de92ff9c564 service nova] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Processing event network-vif-plugged-b456b506-7aaf-4c28-a7ed-bcbb16898b49 {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:40:46.693142 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('--login',): stdout=Logging in to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee, portal: 192.168.40.100,3260] Jun 26 10:40:46.693142 np0000003731 nova-compute[98967]: Login to [iface: default, target: iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee, portal: 192.168.40.100,3260] successful. Jun 26 10:40:46.693142 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:46.698832 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:46.709337 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'automatic'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:46.725640 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:40:46.728631 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lock "connect_to_iscsi_portal-192.168.50.100:3260-iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.267s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:40:46.728631 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Connected to 192.168.50.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:40:46.728631 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] HCTL ('13', '-', '-', 0) found on session 46 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:40:46.728631 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Scanning host 13 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:40:46.734707 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:46.734707 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:46.734707 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:46.734707 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:46.734707 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:46.734707 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:46.734707 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:46.734707 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:46.734707 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:46.734707 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:46.734707 np0000003731 nova-compute[98967]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:46.734707 np0000003731 nova-compute[98967]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:46.734707 np0000003731 nova-compute[98967]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:46.734707 np0000003731 nova-compute[98967]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:46.734707 np0000003731 nova-compute[98967]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:46.734707 np0000003731 nova-compute[98967]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:46.734707 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:40:46.735204 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:46.735204 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:46.735204 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:46.735204 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:46.735204 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:46.735204 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:46.735204 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:46.735204 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:46.735204 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:46.735204 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:46.735204 np0000003731 nova-compute[98967]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:46.735204 np0000003731 nova-compute[98967]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:46.735204 np0000003731 nova-compute[98967]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:46.735204 np0000003731 nova-compute[98967]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:46.735204 np0000003731 nova-compute[98967]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:46.735204 np0000003731 nova-compute[98967]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:46.735204 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:40:46.735204 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lock "connect_to_iscsi_portal-192.168.40.100:3260-iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector._connect_to_iscsi_portal_unsafe" :: held 1.281s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:40:46.735711 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Connected to 192.168.40.100:3260 {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:656}} Jun 26 10:40:46.736910 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] HCTL ('14', '-', '-', 0) found on session 47 with lun 0 {{(pid=98967) get_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:808}} Jun 26 10:40:46.737080 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Scanning host 14 c: -, t: -, l: 0) {{(pid=98967) scan_iscsi /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:834}} Jun 26 10:40:46.748575 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Searching for a device in session 46 and hctl ['13', '*', '*', 0] yield: sdh {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:40:46.748817 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Connected to sdh using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', 'target_portal': '192.168.50.100:3260', 'target_lun': 0, 'volume_id': '0838d3e5-41a4-4e26-b090-b276de7370ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:40:46.763025 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Searching for a device in session 47 and hctl ['14', '*', '*', 0] yield: sdi {{(pid=98967) device_name_by_hctl /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:828}} Jun 26 10:40:46.763128 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Connected to sdi using {'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '0838d3e5-41a4-4e26-b090-b276de7370ee', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True} {{(pid=98967) _connect_vol /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:684}} Jun 26 10:40:47.458954 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] All connection threads finished, giving 10 seconds for dm to appear. {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:786}} Jun 26 10:40:47.483548 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:40:47.484343 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:40:47.484634 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] VM Started (Lifecycle Event) Jun 26 10:40:47.489958 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Guest created on hypervisor {{(pid=98967) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 26 10:40:47.495032 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Instance spawned successfully. Jun 26 10:40:47.497951 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 26 10:40:47.542034 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "qemu-img rebase -b /opt/stack/data/nova/instances/_base/e5b93853a20f0423d15ef4670655d4cbba0b72fe -F raw /opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578/disk" returned: 0 in 1.156s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:47.542471 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Created local disks {{(pid=98967) _create_image /opt/stack/nova/nova/virt/libvirt/driver.py:5363}} Jun 26 10:40:47.542635 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Ensure instance console log exists: /opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578/console.log {{(pid=98967) _ensure_console_log_for_instance /opt/stack/nova/nova/virt/libvirt/driver.py:5100}} Jun 26 10:40:47.542865 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "vgpu_resources" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:47.543038 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "vgpu_resources" acquired by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:47.543166 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "vgpu_resources" "released" by "nova.virt.libvirt.driver.LibvirtDriver._allocate_mdevs" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:47.544604 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Start _get_guest_xml network_info=[{"id": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "address": "fa:16:3e:97:32:1f", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap603c0b2c-d1", "ovs_interfaceid": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] disk_info={'disk_bus': 'virtio', 'cdrom_bus': 'ide', 'mapping': {'root': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk': {'bus': 'virtio', 'dev': 'vda', 'type': 'disk', 'boot_index': '1'}, 'disk.config': {'bus': 'ide', 'dev': 'hda', 'type': 'cdrom'}}} image_meta=ImageMeta(checksum='3e2f514bcff03bb296575f94e70be737',container_format='bare',created_at=2026-06-26T10:40:16Z,direct_url=,disk_format='qcow2',id=6e289f27-47a0-43f7-a307-065de0dfc62a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1844479358-shelved',owner='39600b204ad64a6db28676693c86dd70',properties=ImageMetaProps,protected=,size=53542912,status='active',tags=,updated_at=2026-06-26T10:40:25Z,virtual_size=,visibility=) rescue=None block_device_info={'root_device_name': '/dev/vda', 'image': [{'device_type': 'disk', 'guest_format': None, 'boot_index': 0, 'encryption_options': None, 'size': 0, 'disk_bus': 'virtio', 'device_name': '/dev/vda', 'encryption_format': None, 'encrypted': False, 'encryption_secret_uuid': None, 'image_id': 'a9b18127-6fee-4ed6-b364-a2d634ecb8b7'}], 'ephemerals': [], 'block_device_mapping': [], 'swap': None}share_info=None {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8208}} Jun 26 10:40:47.546297 np0000003731 nova-compute[98967]: WARNING nova.virt.libvirt.driver [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] This host appears to have multiple sockets per NUMA node. The `socket` PCI NUMA affinity will not be supported. Jun 26 10:40:47.547842 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] InstanceDriverMetadata: InstanceDriverMetadata(root_type='image', root_id='a9b18127-6fee-4ed6-b364-a2d634ecb8b7', instance_meta=NovaInstanceMeta(name='tempest-AttachVolumeShelveTestJSON-server-1844479358', uuid='edf92675-15b4-424f-85b5-80341e77b578'), owner=OwnerMeta(userid='2a7c139c060e4c998d31cf957835db61', username='tempest-AttachVolumeShelveTestJSON-959960600-project-member', projectid='39600b204ad64a6db28676693c86dd70', projectname='tempest-AttachVolumeShelveTestJSON-959960600'), image=ImageMeta(id='6e289f27-47a0-43f7-a307-065de0dfc62a', name=None, container_format='bare', disk_format='qcow2', min_disk=1, min_ram=0, properties={'hw_cdrom_bus': 'ide', 'hw_disk_bus': 'virtio', 'hw_machine_type': 'pc', 'hw_rng_model': 'virtio', 'hw_video_model': 'virtio', 'hw_vif_model': 'virtio'}), flavor=FlavorMeta(name='m1.nano', flavorid='42', memory_mb=192, vcpus=1, root_gb=1, ephemeral_gb=0, extra_specs={'hw_rng:allowed': 'True'}, swap=0), network_info=[{"id": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "address": "fa:16:3e:97:32:1f", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap603c0b2c-d1", "ovs_interfaceid": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}], nova_package='33.1.0', creation_time=1782470447.5475094) {{(pid=98967) get_instance_driver_metadata /opt/stack/nova/nova/virt/driver.py:438}} Jun 26 10:40:47.548630 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V1... {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1782}} Jun 26 10:40:47.548940 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CPU controller missing on host. {{(pid=98967) _has_cgroupsv1_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1792}} Jun 26 10:40:47.549760 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Searching host: 'np0000003731' for CPU controller through CGroups V2... {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1801}} Jun 26 10:40:47.549953 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.host [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CPU controller found on host. {{(pid=98967) _has_cgroupsv2_cpu_controller /opt/stack/nova/nova/virt/libvirt/host.py:1808}} Jun 26 10:40:47.550853 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CPU mode 'custom' models 'Nehalem' was chosen, with extra flags: '' {{(pid=98967) _get_guest_cpu_model_config /opt/stack/nova/nova/virt/libvirt/driver.py:5902}} Jun 26 10:40:47.551156 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Getting desirable topologies for flavor Flavor(created_at=2026-06-26T10:34:48Z,deleted=False,deleted_at=None,description=None,disabled=False,ephemeral_gb=0,extra_specs={hw_rng:allowed='True'},flavorid='42',id=11,is_public=True,memory_mb=192,name='m1.nano',projects=,root_gb=1,rxtx_factor=1.0,swap=0,updated_at=None,vcpu_weight=0,vcpus=1) and image_meta ImageMeta(checksum='3e2f514bcff03bb296575f94e70be737',container_format='bare',created_at=2026-06-26T10:40:16Z,direct_url=,disk_format='qcow2',id=6e289f27-47a0-43f7-a307-065de0dfc62a,min_disk=1,min_ram=0,name='tempest-AttachVolumeShelveTestJSON-server-1844479358-shelved',owner='39600b204ad64a6db28676693c86dd70',properties=ImageMetaProps,protected=,size=53542912,status='active',tags=,updated_at=2026-06-26T10:40:25Z,virtual_size=,visibility=), allow threads: True {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:703}} Jun 26 10:40:47.551282 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Flavor limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:488}} Jun 26 10:40:47.551361 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Image limits 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:492}} Jun 26 10:40:47.551500 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Flavor pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:528}} Jun 26 10:40:47.551579 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Image pref 0:0:0 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:532}} Jun 26 10:40:47.551709 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=98967) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:570}} Jun 26 10:40:47.551782 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Topology preferred VirtCPUTopology(cores=0,sockets=0,threads=0), maximum VirtCPUTopology(cores=65536,sockets=65536,threads=65536) {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:709}} Jun 26 10:40:47.551875 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Build topologies for 1 vcpu(s) 1:1:1 {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:611}} Jun 26 10:40:47.551976 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Got 1 possible topologies {{(pid=98967) _get_possible_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:641}} Jun 26 10:40:47.552098 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Possible topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:715}} Jun 26 10:40:47.552209 np0000003731 nova-compute[98967]: DEBUG nova.virt.hardware [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Sorted desired topologies [VirtCPUTopology(cores=1,sockets=1,threads=1)] {{(pid=98967) _get_desirable_cpu_topologies /opt/stack/nova/nova/virt/hardware.py:717}} Jun 26 10:40:47.552428 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lazy-loading 'vcpu_model' on Instance uuid edf92675-15b4-424f-85b5-80341e77b578 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:47.573353 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:47.679093 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-a909c8a6-8bfa-474c-8b1a-1d7eb3987612 tempest-TaggedBootDevicesTest_v242-2003689595 tempest-TaggedBootDevicesTest_v242-2003689595-project-member] Lock "ee4d14ad-8bd2-4b8b-9526-51abafe757f2" "released" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: held 15.159s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:47.814632 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:40:47.814632 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:40:47.814632 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] No VIF found with MAC fa:16:3e:a4:49:e7, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:40:47.951750 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Starting migrate_disk_and_power_off {{(pid=98967) migrate_disk_and_power_off /opt/stack/nova/nova/virt/libvirt/driver.py:12621}} Jun 26 10:40:47.984727 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:47.987542 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:40:47.990057 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:47.991768 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Synchronizing instance power state after lifecycle event "Started"; current vm_state: building, current task_state: spawning, current DB power_state: 0, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:40:48.010047 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:48.013440 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Found default for hw_cdrom_bus of ide {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:40:48.013440 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Found default for hw_disk_bus of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:40:48.013440 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Found default for hw_input_bus of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:40:48.014309 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Found default for hw_pointer_model of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:40:48.014615 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Found default for hw_video_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:40:48.014914 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Found default for hw_vif_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:40:48.054651 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Object Instance lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:40:48.066996 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-26T10:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1844479358',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-attachvolumeshelvetestjson-server-1844479358',id=21,image_ref='6e289f27-47a0-43f7-a307-065de0dfc62a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-52848182',keypairs=,launch_index=0,launched_at=2026-06-26T10:39:35Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='39600b204ad64a6db28676693c86dd70',ramdisk_id='',reservation_id='r-25v3smsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-959960600',owner_user_name='tempest-AttachVolumeShelveTestJSON-959960600-project-member',shelved_at='2026-06-26T10:40:25.376140',shelved_host='np0000003731',shelved_image_id='6e289f27-47a0-43f7-a307-065de0dfc62a'},tags=,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:40:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a7c139c060e4c998d31cf957835db61',uuid=edf92675-15b4-424f-85b5-80341e77b578,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "address": "fa:16:3e:97:32:1f", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap603c0b2c-d1", "ovs_interfaceid": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:40:48.067245 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Converting VIF {"id": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "address": "fa:16:3e:97:32:1f", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap603c0b2c-d1", "ovs_interfaceid": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:40:48.067875 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:32:1f,bridge_name='br-int',has_traffic_filtering=True,id=603c0b2c-d13b-48d6-a1a0-77c17c62c23e,network=Network(79bcd519-98c3-4905-a83f-c080654f2cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603c0b2c-d1') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:40:48.068412 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lazy-loading 'pci_devices' on Instance uuid edf92675-15b4-424f-85b5-80341e77b578 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:48.185363 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:48.192953 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:48.228102 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7992a28f-56e8-4712-90ef-96bcc5bfc143 req-96caa257-1868-4cb2-adc0-9a3586b02228 service nova] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Received event network-vif-unplugged-b747180c-b090-4936-90bc-0c6553817170 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:48.228538 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7992a28f-56e8-4712-90ef-96bcc5bfc143 req-96caa257-1868-4cb2-adc0-9a3586b02228 service nova] Acquiring lock "f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:48.228898 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7992a28f-56e8-4712-90ef-96bcc5bfc143 req-96caa257-1868-4cb2-adc0-9a3586b02228 service nova] Lock "f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:48.229586 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7992a28f-56e8-4712-90ef-96bcc5bfc143 req-96caa257-1868-4cb2-adc0-9a3586b02228 service nova] Lock "f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:48.230018 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7992a28f-56e8-4712-90ef-96bcc5bfc143 req-96caa257-1868-4cb2-adc0-9a3586b02228 service nova] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] No waiting events found dispatching network-vif-unplugged-b747180c-b090-4936-90bc-0c6553817170 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:48.230298 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-7992a28f-56e8-4712-90ef-96bcc5bfc143 req-96caa257-1868-4cb2-adc0-9a3586b02228 service nova] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Received unexpected event network-vif-unplugged-b747180c-b090-4936-90bc-0c6553817170 for instance with vm_state active and task_state resize_migrating. Jun 26 10:40:48.318023 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Instance destroyed successfully. Jun 26 10:40:48.321289 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:45Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='multiattach-server-1',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='multiattach-server-1',id=18,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKIANZiDTtI5cmApVvRJAaLuw+rm1nR4eCOZjHwVoNWhAR53DFExlyLfMWz+jjXnkCXdfpUcLxD2eMk9e+d1HV7SCzQccChfvPKV4jw2Mlc92UdPlKs2IxpAJWXP9L/ysw==',key_name='tempest-keypair-1990365436',keypairs=,launch_index=0,launched_at=2026-06-26T10:39:07Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=MigrationContext,new_flavor=Flavor(12),node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='49c2798faed447838b6c87f6d15cce66',ramdisk_id='',reservation_id='r-vx44ocjv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=ServiceList,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',old_vm_state='active',owner_project_name='tempest-AttachVolumeMultiAttachTest-1668992443',owner_user_name='tempest-AttachVolumeMultiAttachTest-1668992443-project-member'},tags=,task_state='resize_migrating',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:40:39Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='8a8a0b0240a34fb0bcf62ee7ec259cb2',uuid=f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "b747180c-b090-4936-90bc-0c6553817170", "address": "fa:16:3e:43:d8:28", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "vif_mac": "fa:16:3e:43:d8:28"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb747180c-b0", "ovs_interfaceid": "b747180c-b090-4936-90bc-0c6553817170", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 26 10:40:48.321626 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Converting VIF {"id": "b747180c-b090-4936-90bc-0c6553817170", "address": "fa:16:3e:43:d8:28", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [], "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "vif_mac": "fa:16:3e:43:d8:28"}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb747180c-b0", "ovs_interfaceid": "b747180c-b090-4936-90bc-0c6553817170", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:40:48.322709 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:43:d8:28,bridge_name='br-int',has_traffic_filtering=True,id=b747180c-b090-4936-90bc-0c6553817170,network=Network(204eb6a3-9452-412e-ab0b-1594eb86bed2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb747180c-b0') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:40:48.323089 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:d8:28,bridge_name='br-int',has_traffic_filtering=True,id=b747180c-b090-4936-90bc-0c6553817170,network=Network(204eb6a3-9452-412e-ab0b-1594eb86bed2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb747180c-b0') {{(pid=98967) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 26 10:40:48.330115 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:48.330115 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tapb747180c-b0, bridge=br-int, if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:48.331061 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:48.332326 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:48.332907 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:48.337239 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:48.337720 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=346b14e7-e65e-490e-a0fd-e32e6a391028) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:48.338361 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:48.338959 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:48.339445 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:48.343153 np0000003731 nova-compute[98967]: INFO os_vif [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:43:d8:28,bridge_name='br-int',has_traffic_filtering=True,id=b747180c-b090-4936-90bc-0c6553817170,network=Network(204eb6a3-9452-412e-ab0b-1594eb86bed2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tapb747180c-b0') Jun 26 10:40:48.477417 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Found WWN 3300000003cd6755d for multipath device dm-7 {{(pid=98967) _connect_multipath_volume /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:812}} Jun 26 10:40:48.478044 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.connect_volume" :: held 3.046s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:40:48.478044 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] <== connect_volume: return (7323ms) {'type': 'block', 'scsi_wwn': '3300000003cd6755d', 'path': '/dev/dm-7', 'multipath_id': '3300000003cd6755d'} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:40:48.478044 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Attached iSCSI volume {'type': 'block', 'scsi_wwn': '3300000003cd6755d', 'path': '/dev/dm-7', 'multipath_id': '3300000003cd6755d'} {{(pid=98967) connect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:67}} Jun 26 10:40:48.479089 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.272s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:40:48.479967 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': '40e55112-eb2e-46ce-ba3b-b050f86c7c24', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-14'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 10:40:48.480564 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', 0)] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 10:40:48.494917 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] During sync_power_state the instance has a pending task (spawning). Skip. Jun 26 10:40:48.495316 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Paused> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:40:48.495394 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] VM Paused (Lifecycle Event) Jun 26 10:40:48.525130 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Took 9.25 seconds to spawn the instance on the hypervisor. Jun 26 10:40:48.525130 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: tcp: [40] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: tcp: [41] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24 (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', '40'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', '41'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', '47')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', '41')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:40:48.539275 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24', '40')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:40:48.541426 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Resulting device map defaultdict(. at 0x75f07068ca40>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24'): ({'sds'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24'): ({'sdr'}, set())}) {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 10:40:48.541426 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Removing multipathed devices sdr, sds {{(pid=98967) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 10:40:48.541772 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Flush multipath device 330000000e9c36c73 {{(pid=98967) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 26 10:40:48.570903 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Object Instance lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] End _get_guest_xml xml= Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: edf92675-15b4-424f-85b5-80341e77b578 Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: instance-00000015 Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: 196608 Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: tempest-AttachVolumeShelveTestJSON-server-1844479358 Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: 2026-06-26 10:40:47 Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: 192 Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: 0 Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: 0 Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: True Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: bare Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: 0 Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: ide Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: virtio Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: pc Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: virtio Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: virtio Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: virtio Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: tempest-AttachVolumeShelveTestJSON-959960600-project-member Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: tempest-AttachVolumeShelveTestJSON-959960600 Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: edf92675-15b4-424f-85b5-80341e77b578 Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: edf92675-15b4-424f-85b5-80341e77b578 Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: hvm Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: 128 Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:40:48.572485 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Preparing to wait for external event network-vif-plugged-603c0b2c-d13b-48d6-a1a0-77c17c62c23e {{(pid=98967) prepare_for_instance_event /opt/stack/nova/nova/compute/manager.py:306}} Jun 26 10:40:48.584405 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Acquiring lock "edf92675-15b4-424f-85b5-80341e77b578-events" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:48.584405 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "edf92675-15b4-424f-85b5-80341e77b578-events" acquired by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:48.584405 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "edf92675-15b4-424f-85b5-80341e77b578-events" "released" by "nova.compute.manager.InstanceEvents.prepare_for_instance_event.._create_or_get_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:48.584405 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-26T10:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-server-1844479358',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-attachvolumeshelvetestjson-server-1844479358',id=21,image_ref='6e289f27-47a0-43f7-a307-065de0dfc62a',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data=None,key_name='tempest-keypair-52848182',keypairs=,launch_index=0,launched_at=2026-06-26T10:39:35Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=4,progress=0,project_id='39600b204ad64a6db28676693c86dd70',ramdisk_id='',reservation_id='r-25v3smsv',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-AttachVolumeShelveTestJSON-959960600',owner_user_name='tempest-AttachVolumeShelveTestJSON-959960600-project-member',shelved_at='2026-06-26T10:40:25.376140',shelved_host='np0000003731',shelved_image_id='6e289f27-47a0-43f7-a307-065de0dfc62a'},tags=,task_state='spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:40:36Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2a7c139c060e4c998d31cf957835db61',uuid=edf92675-15b4-424f-85b5-80341e77b578,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='shelved_offloaded') vif={"id": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "address": "fa:16:3e:97:32:1f", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap603c0b2c-d1", "ovs_interfaceid": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:40:48.584405 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Converting VIF {"id": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "address": "fa:16:3e:97:32:1f", "network": {"id": "79bcd519-98c3-4905-a83f-c080654f2cf2", "bridge": "br-int", "label": "tempest-AttachVolumeShelveTestJSON-210844640-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.3", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.166", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "39600b204ad64a6db28676693c86dd70", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap603c0b2c-d1", "ovs_interfaceid": "603c0b2c-d13b-48d6-a1a0-77c17c62c23e", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:40:48.584405 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Converted object VIFOpenVSwitch(active=False,address=fa:16:3e:97:32:1f,bridge_name='br-int',has_traffic_filtering=True,id=603c0b2c-d13b-48d6-a1a0-77c17c62c23e,network=Network(79bcd519-98c3-4905-a83f-c080654f2cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603c0b2c-d1') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:40:48.584405 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Plugging vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:32:1f,bridge_name='br-int',has_traffic_filtering=True,id=603c0b2c-d13b-48d6-a1a0-77c17c62c23e,network=Network(79bcd519-98c3-4905-a83f-c080654f2cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603c0b2c-d1') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:40:48.584405 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:48.584405 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:48.584405 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:40:48.584405 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:48.584405 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': '5d5070d2-ddb1-5953-abd4-f820a980c760', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:48.584405 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Remove SCSI device /dev/sdr with /sys/block/sdr/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:40:48.584405 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:48.584405 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:48.584886 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:48.587253 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:48.587544 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap603c0b2c-d1, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:48.587980 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap603c0b2c-d1, col_values=(('qos', UUID('4d1cf8a1-54a4-469c-a07f-03bccd1922e1')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:48.588216 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap603c0b2c-d1, col_values=(('external_ids', {'iface-id': '603c0b2c-d13b-48d6-a1a0-77c17c62c23e', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:97:32:1f', 'vm-uuid': 'edf92675-15b4-424f-85b5-80341e77b578'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:48.589691 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:48.591292 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:48.598385 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:48.599238 np0000003731 nova-compute[98967]: INFO os_vif [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Successfully plugged vif VIFOpenVSwitch(active=False,address=fa:16:3e:97:32:1f,bridge_name='br-int',has_traffic_filtering=True,id=603c0b2c-d13b-48d6-a1a0-77c17c62c23e,network=Network(79bcd519-98c3-4905-a83f-c080654f2cf2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap603c0b2c-d1') Jun 26 10:40:48.634041 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Remove SCSI device /dev/sds with /sys/block/sds/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:40:48.687609 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Checking to see if SCSI volumes sdr, sds have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 10:40:48.687890 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] SCSI volumes sdr, sds have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 10:40:48.690440 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Checking to see if device paths {'sdr', 'sds'} are still under multipathd monitoring {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 10:40:48.704349 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Device paths {'sdr', 'sds'} have been removed from multipathd monitoring. {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 10:40:48.704715 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24')] {{(pid=98967) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 10:40:48.721701 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:48.780640 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 41, target: iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24, portal: 192.168.40.100,3260] Jun 26 10:40:48.780640 np0000003731 nova-compute[98967]: Logout of [sid: 41, target: iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24, portal: 192.168.40.100,3260] successful. Jun 26 10:40:48.780640 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:48.796917 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-3bdc86f5-c442-4b61-b657-e7669d0542ea req-1e6779d7-6a2d-4091-baa7-7e9837a220ab service nova] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Received event network-vif-plugged-b456b506-7aaf-4c28-a7ed-bcbb16898b49 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:48.800523 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-3bdc86f5-c442-4b61-b657-e7669d0542ea req-1e6779d7-6a2d-4091-baa7-7e9837a220ab service nova] Acquiring lock "7edf2e67-5bc5-420a-8674-997ea5a30152-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:48.800784 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-3bdc86f5-c442-4b61-b657-e7669d0542ea req-1e6779d7-6a2d-4091-baa7-7e9837a220ab service nova] Lock "7edf2e67-5bc5-420a-8674-997ea5a30152-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:48.800956 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-3bdc86f5-c442-4b61-b657-e7669d0542ea req-1e6779d7-6a2d-4091-baa7-7e9837a220ab service nova] Lock "7edf2e67-5bc5-420a-8674-997ea5a30152-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:48.801242 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-3bdc86f5-c442-4b61-b657-e7669d0542ea req-1e6779d7-6a2d-4091-baa7-7e9837a220ab service nova] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] No waiting events found dispatching network-vif-plugged-b456b506-7aaf-4c28-a7ed-bcbb16898b49 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:48.801385 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-3bdc86f5-c442-4b61-b657-e7669d0542ea req-1e6779d7-6a2d-4091-baa7-7e9837a220ab service nova] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Received unexpected event network-vif-plugged-b456b506-7aaf-4c28-a7ed-bcbb16898b49 for instance with vm_state active and task_state None. Jun 26 10:40:48.806166 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:48.818490 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:48.875537 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 40, target: iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24, portal: 192.168.50.100,3260] Jun 26 10:40:48.875537 np0000003731 nova-compute[98967]: Logout of [sid: 40, target: iqn.2023-03.storpool.com:os--volume-40e55112-eb2e-46ce-ba3b-b050f86c7c24, portal: 192.168.50.100,3260] successful. Jun 26 10:40:48.875537 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:48.892330 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Detected multiple connections on this host for volume: 1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d, skipping target disconnect. Jun 26 10:40:48.900626 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:48.915790 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:48.917465 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.438s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:40:48.917685 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] <== disconnect_volume: return (3710ms) None {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:40:48.917998 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Disconnected iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 26 10:40:48.925391 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 3.209s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:40:48.925391 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2', 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'bcbe644e-6829-4ba9-8208-ed82c54853b2', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-13'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 10:40:48.925850 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2', 0)] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 10:40:48.931186 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Task(fn=>, remaining_delay=-0.01194160499994723 future=) submitted to {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:48.938175 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] Emitting event Stopped> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:40:48.938895 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waiting for the next task {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:48.939949 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] VM Stopped (Lifecycle Event) Jun 26 10:40:48.947795 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Received Task(fn=>, remaining_delay=10.714520602999983 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:48.947795 np0000003731 nova-compute[98967]: DEBUG nova.utils [-] Waitig for the deadline of Task(fn=>, remaining_delay=10.714172217000169 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: tcp: [34] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: tcp: [35] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2 (non-flash) Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', '31'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2', '34'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2', '35'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', '47')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 10:40:48.980498 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2', '34')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:40:48.982419 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2', '35')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:40:48.983579 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Resulting device map defaultdict(. at 0x75f070662520>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2'): ({'sdp'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2'): ({'sdq'}, set())}) {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 10:40:48.984196 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Removing multipathed devices sdp, sdq {{(pid=98967) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 10:40:48.984196 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Flush multipath device 3300000008026e2de {{(pid=98967) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 26 10:40:48.992228 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-26T10:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-24050431',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-serveractionsv293testjson-server-739986196',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpC408hAS7ZHCLcxOORErGa34r6kFwvPfr3Lp/mseMBy2poBV1dMkTaNTtK74/pNLf0Wh6LpCI1nkrL/Xs5OehD5/80bs1kvQaAe6W4GP47k+Sfo1MyP9GisRKDNYuUyg==',key_name='tempest-keypair-400928869',keypairs=,launch_index=0,launched_at=2026-06-26T10:39:42Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='40a4e84471c94128b1ac4dd00ca7177b',ramdisk_id='',reservation_id='r-c2y3fxk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='652e47dc-dbeb-4044-a4a6-a03fd1347421',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1674673586',owner_user_name='tempest-ServerActionsV293TestJSON-1674673586-project-member'},tags=,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11ad63f2d09c4e7dac51c03de3a31f4a',uuid=3dd6ac52-de12-47da-bc90-77d0fff44acf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "address": "fa:16:3e:41:2f:75", "network": {"id": "66d12b1b-32f2-4152-b44c-13e5284b49f9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-186021134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a4e84471c94128b1ac4dd00ca7177b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap288e6be4-7a", "ovs_interfaceid": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:40:48.992228 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Converting VIF {"id": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "address": "fa:16:3e:41:2f:75", "network": {"id": "66d12b1b-32f2-4152-b44c-13e5284b49f9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-186021134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a4e84471c94128b1ac4dd00ca7177b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap288e6be4-7a", "ovs_interfaceid": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:40:48.994902 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:2f:75,bridge_name='br-int',has_traffic_filtering=True,id=288e6be4-7ae8-4847-ad8e-a0b0b95afa6d,network=Network(66d12b1b-32f2-4152-b44c-13e5284b49f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap288e6be4-7a') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] End _get_guest_xml xml= Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: 3dd6ac52-de12-47da-bc90-77d0fff44acf Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: instance-00000016 Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: 196608 Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: tempest-ServerActionsV293TestJSON-server-24050431 Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: 2026-06-26 10:40:40 Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: 192 Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: 0 Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: 0 Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: True Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: bare Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: 0 Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: virtio Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: tempest-ServerActionsV293TestJSON-1674673586-project-member Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: tempest-ServerActionsV293TestJSON-1674673586 Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: 3dd6ac52-de12-47da-bc90-77d0fff44acf Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: 3dd6ac52-de12-47da-bc90-77d0fff44acf Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: hvm Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: 128 Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: 0838d3e5-41a4-4e26-b090-b276de7370ee Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: /dev/urandom Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: Jun 26 10:40:48.995787 np0000003731 nova-compute[98967]: {{(pid=98967) _get_guest_xml /opt/stack/nova/nova/virt/libvirt/driver.py:8215}} Jun 26 10:40:48.998548 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=True,compute_id=1,config_drive='True',created_at=2026-06-26T10:39:19Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description=None,display_name='tempest-ServerActionsV293TestJSON-server-24050431',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-serveractionsv293testjson-server-739986196',id=22,image_ref='',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNpC408hAS7ZHCLcxOORErGa34r6kFwvPfr3Lp/mseMBy2poBV1dMkTaNTtK74/pNLf0Wh6LpCI1nkrL/Xs5OehD5/80bs1kvQaAe6W4GP47k+Sfo1MyP9GisRKDNYuUyg==',key_name='tempest-keypair-400928869',keypairs=,launch_index=0,launched_at=2026-06-26T10:39:42Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={rebuild='server'},migration_context=None,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=PciDeviceList,pci_requests=InstancePCIRequests,power_state=1,progress=0,project_id='40a4e84471c94128b1ac4dd00ca7177b',ramdisk_id='',reservation_id='r-c2y3fxk3',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',clean_attempts='1',image_base_image_ref='652e47dc-dbeb-4044-a4a6-a03fd1347421',image_container_format='bare',image_disk_format='qcow2',image_hw_machine_type='pc',image_hw_rng_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.1-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerActionsV293TestJSON-1674673586',owner_user_name='tempest-ServerActionsV293TestJSON-1674673586-project-member'},tags=,task_state='rebuild_spawning',terminated_at=None,trusted_certs=None,updated_at=2026-06-26T10:40:38Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='11ad63f2d09c4e7dac51c03de3a31f4a',uuid=3dd6ac52-de12-47da-bc90-77d0fff44acf,vcpu_model=VirtCPUModel,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "address": "fa:16:3e:41:2f:75", "network": {"id": "66d12b1b-32f2-4152-b44c-13e5284b49f9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-186021134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a4e84471c94128b1ac4dd00ca7177b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap288e6be4-7a", "ovs_interfaceid": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) plug /opt/stack/nova/nova/virt/libvirt/vif.py:766}} Jun 26 10:40:48.998548 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Converting VIF {"id": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "address": "fa:16:3e:41:2f:75", "network": {"id": "66d12b1b-32f2-4152-b44c-13e5284b49f9", "bridge": "br-int", "label": "tempest-ServerActionsV293TestJSON-186021134-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.55", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "40a4e84471c94128b1ac4dd00ca7177b", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap288e6be4-7a", "ovs_interfaceid": "288e6be4-7ae8-4847-ad8e-a0b0b95afa6d", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:40:48.998548 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:41:2f:75,bridge_name='br-int',has_traffic_filtering=True,id=288e6be4-7ae8-4847-ad8e-a0b0b95afa6d,network=Network(66d12b1b-32f2-4152-b44c-13e5284b49f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap288e6be4-7a') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:40:48.998548 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Plugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:2f:75,bridge_name='br-int',has_traffic_filtering=True,id=288e6be4-7ae8-4847-ad8e-a0b0b95afa6d,network=Network(66d12b1b-32f2-4152-b44c-13e5284b49f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap288e6be4-7a') {{(pid=98967) plug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:93}} Jun 26 10:40:48.999570 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:40:48.999888 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:49.000974 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddBridgeCommand(_result=None, name=br-int, may_exist=True, datapath_type=system) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:49.002837 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Transaction caused no change {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:129}} Jun 26 10:40:49.003747 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:40:49.005950 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] VM Resumed (Lifecycle Event) Jun 26 10:40:49.008727 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:49.008727 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbCreateCommand(_result=None, table=QoS, columns={'type': 'linux-noop', 'external_ids': {'id': 'd06ecd5e-65e6-577c-8e70-2a0d4be3317d', '_type': 'linux-noop'}}, row=False) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:49.010894 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:49.012188 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:49.012895 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/disk --force-share --output=json" returned: 0 in 0.112s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:49.013822 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/disk --force-share --output=json {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:49.030066 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:49.038939 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Remove SCSI device /dev/sdp with /sys/block/sdp/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:40:49.053918 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Took 21.58 seconds to build instance. Jun 26 10:40:49.055347 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:49.055882 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): AddPortCommand(_result=None, bridge=br-int, port=tap288e6be4-7a, may_exist=True, interface_attrs={}) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:49.057210 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=1): DbSetCommand(_result=None, table=Port, record=tap288e6be4-7a, col_values=(('qos', UUID('68dd90de-bf7c-468e-a966-38785bd92e48')),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:49.057466 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=2): DbSetCommand(_result=None, table=Interface, record=tap288e6be4-7a, col_values=(('external_ids', {'iface-id': '288e6be4-7ae8-4847-ad8e-a0b0b95afa6d', 'iface-status': 'active', 'attached-mac': 'fa:16:3e:41:2f:75', 'vm-uuid': '3dd6ac52-de12-47da-bc90-77d0fff44acf'}),), if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:49.059100 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:49.060479 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:49.071107 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:49.072756 np0000003731 nova-compute[98967]: INFO os_vif [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Successfully plugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:41:2f:75,bridge_name='br-int',has_traffic_filtering=True,id=288e6be4-7ae8-4847-ad8e-a0b0b95afa6d,network=Network(66d12b1b-32f2-4152-b44c-13e5284b49f9),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap288e6be4-7a') Jun 26 10:40:49.089058 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Remove SCSI device /dev/sdq with /sys/block/sdq/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:40:49.109824 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=30 -- env LC_ALL=C LANG=C qemu-img info /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/disk --force-share --output=json" returned: 0 in 0.096s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:49.110247 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] skipping disk /dev/dm-8 (vdb) as it is a volume {{(pid=98967) _get_instance_disk_info_from_config /opt/stack/nova/nova/virt/libvirt/driver.py:12349}} Jun 26 10:40:49.111681 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d_resize/disk /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/disk {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:49.143202 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Checking to see if SCSI volumes sdp, sdq have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 10:40:49.143202 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] SCSI volumes sdp, sdq have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 10:40:49.146232 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Checking to see if device paths {'sdp', 'sdq'} are still under multipathd monitoring {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 10:40:49.157867 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Device paths {'sdp', 'sdq'} have been removed from multipathd monitoring. {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 10:40:49.158467 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2')] {{(pid=98967) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 10:40:49.172479 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:49.224342 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 34, target: iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2, portal: 192.168.40.100,3260] Jun 26 10:40:49.224342 np0000003731 nova-compute[98967]: Logout of [sid: 34, target: iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2, portal: 192.168.40.100,3260] successful. Jun 26 10:40:49.224342 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:49.251135 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:49.252060 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "cp -r /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d_resize/disk /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/disk" returned: 0 in 0.140s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:49.253383 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d_resize/disk.config /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/disk.config {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:49.277204 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:49.307138 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "cp -r /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d_resize/disk.config /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/disk.config" returned: 0 in 0.054s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:49.307561 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): cp -r /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d_resize/disk.info /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/disk.info {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:49.321883 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 35, target: iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2, portal: 192.168.50.100,3260] Jun 26 10:40:49.321883 np0000003731 nova-compute[98967]: Logout of [sid: 35, target: iqn.2023-03.storpool.com:os--volume-bcbe644e-6829-4ba9-8208-ed82c54853b2, portal: 192.168.50.100,3260] successful. Jun 26 10:40:49.321883 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:49.348974 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:49.349587 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.426s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:40:49.349857 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] <== disconnect_volume: return (3635ms) None {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:40:49.350130 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Disconnected iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 26 10:40:49.353807 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] CMD "cp -r /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d_resize/disk.info /opt/stack/data/nova/instances/f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d/disk.info" returned: 0 in 0.046s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:49.405934 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-8fb08991-102e-41b7-9505-3621104a5fba tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lock "619d915a-12c9-424f-8c12-b2a3f94a4109" "released" by "nova.compute.manager.ComputeManager.attach_volume..do_attach_volume" :: held 10.163s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:49.454379 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-21066f7f-49a5-42ae-80eb-373bb6f047c5 tempest-TaggedBootDevicesTest-1397657593 tempest-TaggedBootDevicesTest-1397657593-project-member] [instance: ee4d14ad-8bd2-4b8b-9526-51abafe757f2] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:40:49.511672 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:40:49.530347 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Synchronizing instance power state after lifecycle event "Resumed"; current vm_state: active, current task_state: None, current DB power_state: 1, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:40:49.557418 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-e0f3d726-e4b0-4681-88c4-d5bce5fb872a tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lock "7edf2e67-5bc5-420a-8674-997ea5a30152" "released" by "nova.compute.manager.ComputeManager.build_and_run_instance.._locked_do_build_and_run_instance" :: held 23.093s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:49.889462 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:49.922883 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'flavor' on Instance uuid c8aff61a-5f59-4f8c-8288-abd5a7853474 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:50.034288 np0000003731 nova-compute[98967]: DEBUG nova.utils [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Queued Task(fn=>, remaining_delay=14.99970605700014 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:50.157464 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:40:50.157634 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:40:50.157734 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] No VIF found with MAC fa:16:3e:97:32:1f, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:40:50.158287 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Using config drive Jun 26 10:40:50.175941 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:50.175941 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:50.315251 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-ed782ad1-c8ed-4f5f-8c0f-ec1f3036b53a req-71b2f6ab-870e-4a63-a0d0-c861d672e6c2 service nova] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Received event network-vif-unplugged-b747180c-b090-4936-90bc-0c6553817170 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:50.316142 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-ed782ad1-c8ed-4f5f-8c0f-ec1f3036b53a req-71b2f6ab-870e-4a63-a0d0-c861d672e6c2 service nova] Acquiring lock "f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:50.317722 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-ed782ad1-c8ed-4f5f-8c0f-ec1f3036b53a req-71b2f6ab-870e-4a63-a0d0-c861d672e6c2 service nova] Lock "f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.002s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:50.317891 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-ed782ad1-c8ed-4f5f-8c0f-ec1f3036b53a req-71b2f6ab-870e-4a63-a0d0-c861d672e6c2 service nova] Lock "f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:50.318272 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-ed782ad1-c8ed-4f5f-8c0f-ec1f3036b53a req-71b2f6ab-870e-4a63-a0d0-c861d672e6c2 service nova] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] No waiting events found dispatching network-vif-unplugged-b747180c-b090-4936-90bc-0c6553817170 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:50.318467 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-ed782ad1-c8ed-4f5f-8c0f-ec1f3036b53a req-71b2f6ab-870e-4a63-a0d0-c861d672e6c2 service nova] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Received unexpected event network-vif-unplugged-b747180c-b090-4936-90bc-0c6553817170 for instance with vm_state active and task_state resize_migrating. Jun 26 10:40:50.541918 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:50.542506 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:50.606168 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] No BDM found with device name hda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:40:50.606297 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] No BDM found with device name vda, not building metadata. {{(pid=98967) _build_disk_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13228}} Jun 26 10:40:50.606421 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] No VIF found with MAC fa:16:3e:41:2f:75, not building metadata {{(pid=98967) _build_interface_metadata /opt/stack/nova/nova/virt/libvirt/driver.py:13204}} Jun 26 10:40:50.606832 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Using config drive Jun 26 10:40:50.663211 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lazy-loading 'ec2_ids' on Instance uuid edf92675-15b4-424f-85b5-80341e77b578 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:50.678538 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lazy-loading 'migration_context' on Instance uuid 3a56a898-691e-473e-a5c1-d618e861087b {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:50.740722 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Port b747180c-b090-4936-90bc-0c6553817170 binding to destination host np0000003731 is already ACTIVE {{(pid=98967) migrate_instance_start /opt/stack/nova/nova/network/neutron.py:3210}} Jun 26 10:40:50.930620 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-65dfbf07-ef8a-4f5b-914c-ca5fac8f4ea3 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 6.523s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:51.110175 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lazy-loading 'ec2_ids' on Instance uuid 3dd6ac52-de12-47da-bc90-77d0fff44acf {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:51.173132 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Object Instance lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:40:51.173132 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lazy-loading 'keypairs' on Instance uuid edf92675-15b4-424f-85b5-80341e77b578 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:51.180844 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Object Instance<3a56a898-691e-473e-a5c1-d618e861087b> lazy-loaded attributes: resources,migration_context {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:40:51.615178 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Object Instance<3dd6ac52-de12-47da-bc90-77d0fff44acf> lazy-loaded attributes: vcpu_model,ec2_ids {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:40:51.615178 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lazy-loading 'keypairs' on Instance uuid 3dd6ac52-de12-47da-bc90-77d0fff44acf {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:51.675685 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Object Instance lazy-loaded attributes: pci_requests,trusted_certs,migration_context,vcpu_model,pci_devices,ec2_ids,keypairs {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:40:51.680463 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:51.752608 np0000003731 nova-compute[98967]: DEBUG nova.compute.rpcapi [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98967) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 26 10:40:51.787200 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:51.787556 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:51.789472 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Lock "f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:51.888740 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Creating config drive at /opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578/disk.config Jun 26 10:40:51.889447 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Acquiring lock "619d915a-12c9-424f-8c12-b2a3f94a4109" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:51.901093 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lock "619d915a-12c9-424f-8c12-b2a3f94a4109" acquired by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:51.901093 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-28d97658-341e-49ab-a4bc-6d172c3ddcff tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Rescuing Jun 26 10:40:51.901093 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-28d97658-341e-49ab-a4bc-6d172c3ddcff tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquiring lock "refresh_cache-7edf2e67-5bc5-420a-8674-997ea5a30152" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:40:51.901093 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-28d97658-341e-49ab-a4bc-6d172c3ddcff tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Acquired lock "refresh_cache-7edf2e67-5bc5-420a-8674-997ea5a30152" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:40:51.901093 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-28d97658-341e-49ab-a4bc-6d172c3ddcff tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:40:51.903728 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsgwegjvh {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:51.969289 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/edf92675-15b4-424f-85b5-80341e77b578/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmpsgwegjvh" returned: 0 in 0.065s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:52.126490 np0000003731 nova-compute[98967]: DEBUG nova.objects.base [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Object Instance<3dd6ac52-de12-47da-bc90-77d0fff44acf> lazy-loaded attributes: vcpu_model,ec2_ids,keypairs {{(pid=98967) wrapper /opt/stack/nova/nova/objects/base.py:136}} Jun 26 10:40:52.134346 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release.: NotImplementedError Jun 26 10:40:52.278904 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-8dac687f-8be8-423b-9e71-111335e91868 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "c8aff61a-5f59-4f8c-8288-abd5a7853474" by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:52.279370 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-8dac687f-8be8-423b-9e71-111335e91868 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474" acquired by "nova.compute.manager.ComputeManager.terminate_instance..do_terminate_instance" :: waited 0.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:52.279647 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-8dac687f-8be8-423b-9e71-111335e91868 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Acquiring lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:52.279822 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-8dac687f-8be8-423b-9e71-111335e91868 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" acquired by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:52.279938 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-8dac687f-8be8-423b-9e71-111335e91868 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" "released" by "nova.compute.manager.InstanceEvents.clear_events_for_instance.._clear_events" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:52.282912 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-8dac687f-8be8-423b-9e71-111335e91868 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Terminating instance Jun 26 10:40:52.334985 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Creating config drive at /opt/stack/data/nova/instances/3dd6ac52-de12-47da-bc90-77d0fff44acf/disk.config Jun 26 10:40:52.340482 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Running cmd (subprocess): genisoimage -o /opt/stack/data/nova/instances/3dd6ac52-de12-47da-bc90-77d0fff44acf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5ik_w519 {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:52.393888 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Detaching volume f75790bf-71bb-4447-80b7-693d4f5a7065 Jun 26 10:40:52.398976 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Available memory encrypted slots: amd_sev=0 amd_sev_es=0 {{(pid=98967) _get_memory_encryption_inventories /opt/stack/nova/nova/virt/libvirt/driver.py:9967}} Jun 26 10:40:52.400065 np0000003731 nova-compute[98967]: DEBUG nova.compute.provider_tree [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Inventory has not changed in ProviderTree for provider: 7149a1d0-8a83-4b86-a06a-b678e317ee9d {{(pid=98967) update_inventory /opt/stack/nova/nova/compute/provider_tree.py:180}} Jun 26 10:40:52.402285 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] CMD "genisoimage -o /opt/stack/data/nova/instances/3dd6ac52-de12-47da-bc90-77d0fff44acf/disk.config -ldots -allow-lowercase -allow-multidot -l -publisher OpenStack Nova 33.1.0 -quiet -J -r -V config-2 /tmp/tmp5ik_w519" returned: 0 in 0.062s {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jun 26 10:40:52.403111 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-28d97658-341e-49ab-a4bc-6d172c3ddcff tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:52.455256 np0000003731 nova-compute[98967]: INFO nova.virt.block_device [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Attempting to driver detach volume f75790bf-71bb-4447-80b7-693d4f5a7065 from mountpoint /dev/vdb Jun 26 10:40:52.472381 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Found disk vdb by alias ua-f75790bf-71bb-4447-80b7-693d4f5a7065 {{(pid=98967) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 26 10:40:52.474557 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Found disk vdb by alias ua-f75790bf-71bb-4447-80b7-693d4f5a7065 {{(pid=98967) _get_guest_disk_device /opt/stack/nova/nova/virt/libvirt/driver.py:2882}} Jun 26 10:40:52.474784 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Attempting to detach device vdb from instance 619d915a-12c9-424f-8c12-b2a3f94a4109 from the persistent domain config. {{(pid=98967) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 26 10:40:52.475137 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] detach device xml: Jun 26 10:40:52.475137 np0000003731 nova-compute[98967]: Jun 26 10:40:52.475137 np0000003731 nova-compute[98967]: Jun 26 10:40:52.475137 np0000003731 nova-compute[98967]: Jun 26 10:40:52.475137 np0000003731 nova-compute[98967]: Jun 26 10:40:52.475137 np0000003731 nova-compute[98967]: f75790bf-71bb-4447-80b7-693d4f5a7065 Jun 26 10:40:52.475137 np0000003731 nova-compute[98967]:
Jun 26 10:40:52.475137 np0000003731 nova-compute[98967]: Jun 26 10:40:52.475137 np0000003731 nova-compute[98967]: {{(pid=98967) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 26 10:40:52.509693 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Successfully detached device vdb from instance 619d915a-12c9-424f-8c12-b2a3f94a4109 from the persistent domain config. Jun 26 10:40:52.509693 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] (1/8): Attempting to detach device vdb with device alias ua-f75790bf-71bb-4447-80b7-693d4f5a7065 from instance 619d915a-12c9-424f-8c12-b2a3f94a4109 from the live domain config. {{(pid=98967) _detach_from_live_with_retry /opt/stack/nova/nova/virt/libvirt/driver.py:2666}} Jun 26 10:40:52.512272 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] detach device xml: Jun 26 10:40:52.512272 np0000003731 nova-compute[98967]: Jun 26 10:40:52.512272 np0000003731 nova-compute[98967]: Jun 26 10:40:52.512272 np0000003731 nova-compute[98967]: Jun 26 10:40:52.512272 np0000003731 nova-compute[98967]: Jun 26 10:40:52.512272 np0000003731 nova-compute[98967]: f75790bf-71bb-4447-80b7-693d4f5a7065 Jun 26 10:40:52.512272 np0000003731 nova-compute[98967]:
Jun 26 10:40:52.512272 np0000003731 nova-compute[98967]: Jun 26 10:40:52.512272 np0000003731 nova-compute[98967]: {{(pid=98967) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 26 10:40:52.531833 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:52.572251 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:52.587097 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:52.777931 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:52.789853 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-8dac687f-8be8-423b-9e71-111335e91868 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Start destroying the instance on the hypervisor. {{(pid=98967) _shutdown_instance /opt/stack/nova/nova/compute/manager.py:3332}} Jun 26 10:40:52.814221 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:52.857774 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:52.866422 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:52.886276 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:52.901374 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-a42690ac-1783-4567-b3d7-8455aa74a8de req-5dd986d8-c248-4c7b-8128-f87784a9f298 service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Received event network-vif-plugged-603c0b2c-d13b-48d6-a1a0-77c17c62c23e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:52.902276 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-a42690ac-1783-4567-b3d7-8455aa74a8de req-5dd986d8-c248-4c7b-8128-f87784a9f298 service nova] Acquiring lock "edf92675-15b4-424f-85b5-80341e77b578-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:52.902276 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-a42690ac-1783-4567-b3d7-8455aa74a8de req-5dd986d8-c248-4c7b-8128-f87784a9f298 service nova] Lock "edf92675-15b4-424f-85b5-80341e77b578-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:52.902276 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-a42690ac-1783-4567-b3d7-8455aa74a8de req-5dd986d8-c248-4c7b-8128-f87784a9f298 service nova] Lock "edf92675-15b4-424f-85b5-80341e77b578-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:52.902276 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-a42690ac-1783-4567-b3d7-8455aa74a8de req-5dd986d8-c248-4c7b-8128-f87784a9f298 service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Processing event network-vif-plugged-603c0b2c-d13b-48d6-a1a0-77c17c62c23e {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11746}} Jun 26 10:40:52.910204 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Inventory has not changed for provider 7149a1d0-8a83-4b86-a06a-b678e317ee9d based on inventory data: {'VCPU': {'total': 16, 'reserved': 0, 'min_unit': 1, 'max_unit': 16, 'step_size': 1, 'allocation_ratio': 4.0}, 'MEMORY_MB': {'total': 64301, 'reserved': 512, 'min_unit': 1, 'max_unit': 64301, 'step_size': 1, 'allocation_ratio': 1.0}, 'DISK_GB': {'total': 95, 'reserved': 0, 'min_unit': 1, 'max_unit': 95, 'step_size': 1, 'allocation_ratio': 1.0}} {{(pid=98967) set_inventory_for_provider /opt/stack/nova/nova/scheduler/client/report.py:958}} Jun 26 10:40:52.920446 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-28d97658-341e-49ab-a4bc-6d172c3ddcff tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:52.926486 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquiring lock "refresh_cache-f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:40:52.927731 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Acquired lock "refresh_cache-f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:40:52.927731 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:40:53.007300 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:53.020586 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:53.033542 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:53.077892 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:53.120128 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-cca13188-efef-45bd-8dc9-b79138c494f5 req-6018245d-0d34-4931-8e5d-0fbe27c950ca service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Received event network-vif-unplugged-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:53.120441 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-cca13188-efef-45bd-8dc9-b79138c494f5 req-6018245d-0d34-4931-8e5d-0fbe27c950ca service nova] Acquiring lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:53.120596 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-cca13188-efef-45bd-8dc9-b79138c494f5 req-6018245d-0d34-4931-8e5d-0fbe27c950ca service nova] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:53.121165 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-cca13188-efef-45bd-8dc9-b79138c494f5 req-6018245d-0d34-4931-8e5d-0fbe27c950ca service nova] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:53.121372 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-cca13188-efef-45bd-8dc9-b79138c494f5 req-6018245d-0d34-4931-8e5d-0fbe27c950ca service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] No waiting events found dispatching network-vif-unplugged-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:53.121530 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-cca13188-efef-45bd-8dc9-b79138c494f5 req-6018245d-0d34-4931-8e5d-0fbe27c950ca service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Received event network-vif-unplugged-93123956-587e-4fec-b4de-833327660f6e for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:40:53.177408 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-28d97658-341e-49ab-a4bc-6d172c3ddcff tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Updating instance_info_cache with network_info: [{"id": "b456b506-7aaf-4c28-a7ed-bcbb16898b49", "address": "fa:16:3e:cb:d9:dc", "network": {"id": "67c50821-8012-4a48-8c3a-b0cc3d2ddcb6", "bridge": "br-int", "label": "tempest-ServerBootFromVolumeStableRescueTest-833331716-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "ea834a26efe148649425d3e02d974ef4", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb456b506-7a", "ovs_interfaceid": "b456b506-7aaf-4c28-a7ed-bcbb16898b49", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:40:53.325951 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:53.346521 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:53.361935 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:53.370838 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:53.433752 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:53.440429 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Start waiting for the detach event from libvirt for device vdb with device alias ua-f75790bf-71bb-4447-80b7-693d4f5a7065 for instance 619d915a-12c9-424f-8c12-b2a3f94a4109 {{(pid=98967) _detach_from_live_and_wait_for_event /opt/stack/nova/nova/virt/libvirt/driver.py:2746}} Jun 26 10:40:53.442885 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Received event ua-f75790bf-71bb-4447-80b7-693d4f5a7065> from libvirt while the driver is waiting for it; dispatched. {{(pid=98967) emit_event /opt/stack/nova/nova/virt/libvirt/driver.py:2519}} Jun 26 10:40:53.472035 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Successfully detached device vdb from instance 619d915a-12c9-424f-8c12-b2a3f94a4109 from the live domain config. Jun 26 10:40:53.500104 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] calling os-brick to detach iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:74}} Jun 26 10:40:53.509030 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] ==> disconnect_volume: call "{'args': (, {'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065', 'iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f75790bf-71bb-4447-80b7-693d4f5a7065', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, None), 'kwargs': {'force': False}}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:40:53.509030 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Acquiring lock "connect_volume" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:67}} Jun 26 10:40:53.509030 np0000003731 nova-compute[98967]: DEBUG nova.utils [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Queued Task(fn=>, remaining_delay=14.999698994000028 future=) {{(pid=98967) _log /opt/stack/nova/nova/utils.py:1508}} Jun 26 10:40:53.509030 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lock "connect_volume" acquired by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: waited 0.002s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:72}} Jun 26 10:40:53.509030 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] _get_connection_devices called with parameters: connection_properties={'target_iqns': ['iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065', 'iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065'], 'target_portals': ['192.168.40.100:3260', '192.168.50.100:3260'], 'target_luns': [0, 0], 'target_discovered': False, 'target_iqn': 'iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065', 'target_portal': '192.168.40.100:3260', 'target_lun': 0, 'volume_id': 'f75790bf-71bb-4447-80b7-693d4f5a7065', 'discard': True, 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'enforce_multipath': True, 'device_path': '/dev/dm-6'}, ips_iqns_luns=None, is_disconnect_call=True {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:847}} Jun 26 10:40:53.509030 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Got connected devices for (ips,iqns,luns)=[('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065', 0), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065', 0)] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:858}} Jun 26 10:40:53.521605 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Instance destroyed successfully. Jun 26 10:40:53.527241 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-8dac687f-8be8-423b-9e71-111335e91868 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Lazy-loading 'resources' on Instance uuid c8aff61a-5f59-4f8c-8288-abd5a7853474 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:53.539708 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] iscsiadm ('-m', 'session'): stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:53.539708 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:53.539708 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:53.539708 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:53.539708 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:53.539708 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:53.539708 np0000003731 nova-compute[98967]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:53.539708 np0000003731 nova-compute[98967]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:53.539708 np0000003731 nova-compute[98967]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:53.539708 np0000003731 nova-compute[98967]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:53.539708 np0000003731 nova-compute[98967]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:53.539708 np0000003731 nova-compute[98967]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:53.539708 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm_bare /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1247}} Jun 26 10:40:53.540222 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] iscsi session list stdout=tcp: [2] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:53.540222 np0000003731 nova-compute[98967]: tcp: [28] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:53.540222 np0000003731 nova-compute[98967]: tcp: [29] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d (non-flash) Jun 26 10:40:53.540222 np0000003731 nova-compute[98967]: tcp: [3] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0 (non-flash) Jun 26 10:40:53.540222 np0000003731 nova-compute[98967]: tcp: [30] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:53.540222 np0000003731 nova-compute[98967]: tcp: [31] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84 (non-flash) Jun 26 10:40:53.540222 np0000003731 nova-compute[98967]: tcp: [42] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:53.540222 np0000003731 nova-compute[98967]: tcp: [43] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6 (non-flash) Jun 26 10:40:53.540222 np0000003731 nova-compute[98967]: tcp: [44] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:53.540222 np0000003731 nova-compute[98967]: tcp: [45] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065 (non-flash) Jun 26 10:40:53.540222 np0000003731 nova-compute[98967]: tcp: [46] 192.168.50.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:53.540222 np0000003731 nova-compute[98967]: tcp: [47] 192.168.40.100:3260,1 iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee (non-flash) Jun 26 10:40:53.540222 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsi_session /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1236}} Jun 26 10:40:53.540222 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Sessions list: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '2'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', '28'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-1bc414ff-b5ac-443d-b4d3-68ae41c2cf2d', '29'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-231967fc-b56e-42ba-83e3-550c9b1adce0', '3'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', '30'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-dc71798f-22b5-44d3-8fac-77084df22f84', '31'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6', '42'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f109100b-1f3d-418a-9112-045de874c2e6', '43'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065', '44'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065', '45'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', '46'), ('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-0838d3e5-41a4-4e26-b090-b276de7370ee', '47')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:866}} Jun 26 10:40:53.540222 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Matching sessions for (ip, iqn, lun)=(192.168.40.100:3260, iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065, 0): [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065', '44')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:40:53.541670 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Matching sessions for (ip, iqn, lun)=(192.168.50.100:3260, iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065, 0): [('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065', '45')] {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:879}} Jun 26 10:40:53.542804 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Resulting device map defaultdict(. at 0x75f05040b9c0>, {('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065'): ({'sdf'}, set()), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065'): ({'sdg'}, set())}) {{(pid=98967) _get_connection_devices /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:912}} Jun 26 10:40:53.547564 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Removing multipathed devices sdf, sdg {{(pid=98967) remove_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:390}} Jun 26 10:40:53.548047 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Flush multipath device 330000000e630844d {{(pid=98967) flush_multipath_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:471}} Jun 26 10:40:53.590601 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Remove SCSI device /dev/sdf with /sys/block/sdf/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:40:53.600808 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-5a78ad0f-7909-43d2-bec4-f0d94d64ae0a req-769bc6b7-5c8f-46b2-8a37-2985b111e6d3 service nova] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Received event network-vif-plugged-288e6be4-7ae8-4847-ad8e-a0b0b95afa6d {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:53.600808 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5a78ad0f-7909-43d2-bec4-f0d94d64ae0a req-769bc6b7-5c8f-46b2-8a37-2985b111e6d3 service nova] Acquiring lock "3dd6ac52-de12-47da-bc90-77d0fff44acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:53.600808 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5a78ad0f-7909-43d2-bec4-f0d94d64ae0a req-769bc6b7-5c8f-46b2-8a37-2985b111e6d3 service nova] Lock "3dd6ac52-de12-47da-bc90-77d0fff44acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:53.600808 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-5a78ad0f-7909-43d2-bec4-f0d94d64ae0a req-769bc6b7-5c8f-46b2-8a37-2985b111e6d3 service nova] Lock "3dd6ac52-de12-47da-bc90-77d0fff44acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:53.600808 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-5a78ad0f-7909-43d2-bec4-f0d94d64ae0a req-769bc6b7-5c8f-46b2-8a37-2985b111e6d3 service nova] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] No waiting events found dispatching network-vif-plugged-288e6be4-7ae8-4847-ad8e-a0b0b95afa6d {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:53.600808 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-5a78ad0f-7909-43d2-bec4-f0d94d64ae0a req-769bc6b7-5c8f-46b2-8a37-2985b111e6d3 service nova] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Received unexpected event network-vif-plugged-288e6be4-7ae8-4847-ad8e-a0b0b95afa6d for instance with vm_state active and task_state rebuild_spawning. Jun 26 10:40:53.628702 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:53.646799 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Remove SCSI device /dev/sdg with /sys/block/sdg/device/delete {{(pid=98967) remove_scsi_device /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:149}} Jun 26 10:40:53.682716 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-28d97658-341e-49ab-a4bc-6d172c3ddcff tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Releasing lock "refresh_cache-7edf2e67-5bc5-420a-8674-997ea5a30152" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:40:53.706251 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Checking to see if SCSI volumes sdf, sdg have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:157}} Jun 26 10:40:53.712415 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] SCSI volumes sdf, sdg have been removed. {{(pid=98967) wait_for_volumes_removal /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:167}} Jun 26 10:40:53.712415 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Checking to see if device paths {'sdf', 'sdg'} are still under multipathd monitoring {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:362}} Jun 26 10:40:53.723118 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.linuxscsi [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Device paths {'sdf', 'sdg'} have been removed from multipathd monitoring. {{(pid=98967) wait_multipathd_remove_paths /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/linuxscsi.py:367}} Jun 26 10:40:53.723596 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Disconnecting from: [('192.168.40.100:3260', 'iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065'), ('192.168.50.100:3260', 'iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065')] {{(pid=98967) _disconnect_connection /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1225}} Jun 26 10:40:53.732848 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:53.744911 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:53.751759 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:53.759713 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:53.790767 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 44, target: iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065, portal: 192.168.40.100,3260] Jun 26 10:40:53.790767 np0000003731 nova-compute[98967]: Logout of [sid: 44, target: iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065, portal: 192.168.40.100,3260] successful. Jun 26 10:40:53.790767 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:53.791878 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:53.793969 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:53.812920 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:53.823807 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] iscsiadm ('--op', 'update', '-n', 'node.startup', '-v', 'manual'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:53.843473 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:53.866714 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] iscsiadm ('--logout',): stdout=Logging out of session [sid: 45, target: iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065, portal: 192.168.50.100,3260] Jun 26 10:40:53.866714 np0000003731 nova-compute[98967]: Logout of [sid: 45, target: iqn.2023-03.storpool.com:os--volume-f75790bf-71bb-4447-80b7-693d4f5a7065, portal: 192.168.50.100,3260] successful. Jun 26 10:40:53.866714 np0000003731 nova-compute[98967]: stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:53.890558 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] iscsiadm ('--op', 'delete'): stdout= stderr= {{(pid=98967) _run_iscsiadm /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/iscsi.py:1091}} Jun 26 10:40:53.890883 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.base [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lock "connect_volume" "released" by "os_brick.initiator.connectors.iscsi.ISCSIConnector.disconnect_volume" :: held 0.388s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/base.py:86}} Jun 26 10:40:53.891073 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.iscsi [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] <== disconnect_volume: return (390ms) None {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:40:53.891238 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.volume.iscsi [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] [instance: 619d915a-12c9-424f-8c12-b2a3f94a4109] Disconnected iSCSI Volume {{(pid=98967) disconnect_volume /opt/stack/nova/nova/virt/libvirt/volume/iscsi.py:81}} Jun 26 10:40:53.934291 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Lock "compute_resources" "released" by "nova.compute.resource_tracker.ResourceTracker.drop_move_claim_at_dest" :: held 3.758s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:53.934291 np0000003731 nova-compute[98967]: DEBUG nova.compute.rpcapi [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] RPC: Sending the message to topic: compute-alt {{(pid=98967) prepare_for_alt_rpcserver /opt/stack/nova/nova/compute/rpcapi.py:595}} Jun 26 10:40:54.009289 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] [instance: f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d] Updating instance_info_cache with network_info: [{"id": "b747180c-b090-4936-90bc-0c6553817170", "address": "fa:16:3e:43:d8:28", "network": {"id": "204eb6a3-9452-412e-ab0b-1594eb86bed2", "bridge": "br-int", "label": "tempest-AttachVolumeMultiAttachTest-947651071-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.11", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "49c2798faed447838b6c87f6d15cce66", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tapb747180c-b0", "ovs_interfaceid": "b747180c-b090-4936-90bc-0c6553817170", "qbh_params": null, "qbg_params": null, "active": false, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}}] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:40:54.037291 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-8dac687f-8be8-423b-9e71-111335e91868 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:38:39Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=,disable_terminate=False,display_description='tempest-ServerRescueNegativeTestJSON-server-478371896',display_name='tempest-ServerRescueNegativeTestJSON-server-478371896',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-serverrescuenegativetestjson-server-478371896',id=17,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+OGQ8Eo1x4iFVwcFj09jg9sQh3dFHv74SAS4ZWyaekKEeCWVFry7SNIL4HTxAbAqZ7ppe/G6qaUIGoSh5uKAL1TZC+RDK6nNG7j6kwengqZDEKTSAcP05cc2XBMrVz9A==',key_name='tempest-keypair-1478353236',keypairs=,launch_index=0,launched_at=2026-06-26T10:39:58Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003731',numa_topology=None,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='58a58b94e5ec406182da9117e14aa789',ramdisk_id='',reservation_id='r-vvq7102i',resources=None,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-ServerRescueNegativeTestJSON-1439990304',owner_user_name='tempest-ServerRescueNegativeTestJSON-1439990304-project-member'},tags=,task_state='deleting',terminated_at=None,trusted_certs=,updated_at=2026-06-26T10:40:05Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='04176251e13046eb8cfc1908246d4d9d',uuid=c8aff61a-5f59-4f8c-8288-abd5a7853474,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "93123956-587e-4fec-b4de-833327660f6e", "address": "fa:16:3e:78:44:6c", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93123956-58", "ovs_interfaceid": "93123956-587e-4fec-b4de-833327660f6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) unplug /opt/stack/nova/nova/virt/libvirt/vif.py:884}} Jun 26 10:40:54.037291 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-8dac687f-8be8-423b-9e71-111335e91868 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Converting VIF {"id": "93123956-587e-4fec-b4de-833327660f6e", "address": "fa:16:3e:78:44:6c", "network": {"id": "d50baa85-72ef-4bb3-9676-e629d583d3a2", "bridge": "br-int", "label": "tempest-ServerRescueNegativeTestJSON-1544958570-network", "subnets": [{"cidr": "10.1.0.0/28", "dns": [], "gateway": {"address": "10.1.0.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.1.0.12", "type": "fixed", "version": 4, "meta": {}, "floating_ips": [{"address": "172.24.5.116", "type": "floating", "version": 4, "meta": {}}]}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "58a58b94e5ec406182da9117e14aa789", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap93123956-58", "ovs_interfaceid": "93123956-587e-4fec-b4de-833327660f6e", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:40:54.037291 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-8dac687f-8be8-423b-9e71-111335e91868 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:78:44:6c,bridge_name='br-int',has_traffic_filtering=True,id=93123956-587e-4fec-b4de-833327660f6e,network=Network(d50baa85-72ef-4bb3-9676-e629d583d3a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93123956-58') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:40:54.037291 np0000003731 nova-compute[98967]: DEBUG os_vif [None req-8dac687f-8be8-423b-9e71-111335e91868 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Unplugging vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:44:6c,bridge_name='br-int',has_traffic_filtering=True,id=93123956-587e-4fec-b4de-833327660f6e,network=Network(d50baa85-72ef-4bb3-9676-e629d583d3a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93123956-58') {{(pid=98967) unplug /opt/stack/data/venv/lib/python3.12/site-packages/os_vif/__init__.py:133}} Jun 26 10:40:54.037291 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:54.037291 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DelPortCommand(_result=None, port=tap93123956-58, bridge=br-int, if_exists=True) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:54.037291 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:54.037291 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:54.037291 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:54.037291 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 14 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:54.037291 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.transaction [-] Running txn n=1 command(idx=0): DbDestroyCommand(_result=None, table=QoS, record=8972ad5b-41a8-48bc-b92f-d13ac0f2cad8) {{(pid=98967) do_commit /opt/stack/data/venv/lib/python3.12/site-packages/ovsdbapp/backend/ovs_idl/transaction.py:89}} Jun 26 10:40:54.039455 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:54.039455 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] 0-ms timeout {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:248}} Jun 26 10:40:54.043768 np0000003731 nova-compute[98967]: INFO os_vif [None req-8dac687f-8be8-423b-9e71-111335e91868 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Successfully unplugged vif VIFOpenVSwitch(active=True,address=fa:16:3e:78:44:6c,bridge_name='br-int',has_traffic_filtering=True,id=93123956-587e-4fec-b4de-833327660f6e,network=Network(d50baa85-72ef-4bb3-9676-e629d583d3a2),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap93123956-58') Jun 26 10:40:54.043768 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-8dac687f-8be8-423b-9e71-111335e91868 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Deleting instance files /opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474_del Jun 26 10:40:54.043768 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-8dac687f-8be8-423b-9e71-111335e91868 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Deletion of /opt/stack/data/nova/instances/c8aff61a-5f59-4f8c-8288-abd5a7853474_del complete Jun 26 10:40:54.498915 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lazy-loading 'flavor' on Instance uuid 619d915a-12c9-424f-8c12-b2a3f94a4109 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:54.516437 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Releasing lock "refresh_cache-f7bfc8c2-c33f-4956-b0c8-c2c68e8f698d" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jun 26 10:40:54.554985 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-8dac687f-8be8-423b-9e71-111335e91868 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Took 1.77 seconds to destroy the instance on the hypervisor. Jun 26 10:40:54.555764 np0000003731 nova-compute[98967]: DEBUG oslo.service.backend._common.loopingcall [None req-8dac687f-8be8-423b-9e71-111335e91868 tempest-ServerRescueNegativeTestJSON-1439990304 tempest-ServerRescueNegativeTestJSON-1439990304-project-member] Waiting for function nova.compute.manager.ComputeManager._try_deallocate_network.._deallocate_network_with_retries to return. {{(pid=98967) func /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_common/loopingcall.py:419}} Jun 26 10:40:54.555960 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [-] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Deallocating network for instance {{(pid=98967) _deallocate_network /opt/stack/nova/nova/compute/manager.py:2456}} Jun 26 10:40:54.556056 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [-] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] deallocate_for_instance() {{(pid=98967) deallocate_for_instance /opt/stack/nova/nova/network/neutron.py:1842}} Jun 26 10:40:54.556260 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:54.591910 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Instance event wait completed in 0 seconds for network-vif-plugged {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:40:54.592271 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Started> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:40:54.592539 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: edf92675-15b4-424f-85b5-80341e77b578] VM Started (Lifecycle Event) Jun 26 10:40:54.612994 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Guest created on hypervisor {{(pid=98967) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 26 10:40:54.614185 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: edf92675-15b4-424f-85b5-80341e77b578] Instance spawned successfully. Jun 26 10:40:54.626351 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Instance event wait completed in 0 seconds for {{(pid=98967) wait_for_instance_event /opt/stack/nova/nova/compute/manager.py:601}} Jun 26 10:40:54.626351 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Guest created on hypervisor {{(pid=98967) spawn /opt/stack/nova/nova/virt/libvirt/driver.py:4883}} Jun 26 10:40:54.634129 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Instance spawned successfully. Jun 26 10:40:54.637242 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [-] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:54.641030 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Attempting to register defaults for the following image properties: ['hw_cdrom_bus', 'hw_disk_bus', 'hw_input_bus', 'hw_pointer_model', 'hw_video_model', 'hw_vif_model'] {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1012}} Jun 26 10:40:54.998210 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-e939ac6e-5788-474d-aa7d-e6e76ec8e917 req-870e6fbe-cac3-4f3c-800d-b07c17723b2c service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Received event network-vif-plugged-603c0b2c-d13b-48d6-a1a0-77c17c62c23e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:54.999225 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-e939ac6e-5788-474d-aa7d-e6e76ec8e917 req-870e6fbe-cac3-4f3c-800d-b07c17723b2c service nova] Acquiring lock "edf92675-15b4-424f-85b5-80341e77b578-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:54.999579 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-e939ac6e-5788-474d-aa7d-e6e76ec8e917 req-870e6fbe-cac3-4f3c-800d-b07c17723b2c service nova] Lock "edf92675-15b4-424f-85b5-80341e77b578-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:54.999760 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-e939ac6e-5788-474d-aa7d-e6e76ec8e917 req-870e6fbe-cac3-4f3c-800d-b07c17723b2c service nova] Lock "edf92675-15b4-424f-85b5-80341e77b578-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:54.999929 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-e939ac6e-5788-474d-aa7d-e6e76ec8e917 req-870e6fbe-cac3-4f3c-800d-b07c17723b2c service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] No waiting events found dispatching network-vif-plugged-603c0b2c-d13b-48d6-a1a0-77c17c62c23e {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:55.000078 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-e939ac6e-5788-474d-aa7d-e6e76ec8e917 req-870e6fbe-cac3-4f3c-800d-b07c17723b2c service nova] [instance: edf92675-15b4-424f-85b5-80341e77b578] Received unexpected event network-vif-plugged-603c0b2c-d13b-48d6-a1a0-77c17c62c23e for instance with vm_state shelved_offloaded and task_state spawning. Jun 26 10:40:55.024306 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] ==> get_connector_properties: call "{'root_helper': 'sudo nova-rootwrap /etc/nova/rootwrap.conf', 'my_ip': '10.4.3.79', 'multipath': True, 'enforce_multipath': True, 'host': 'np0000003731', 'execute': None}" {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:175}} Jun 26 10:40:55.038708 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.scaleio [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Failed to query sdc guid: [Errno 2] No such file or directory {{(pid=98967) _get_guid /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/scaleio.py:91}} Jun 26 10:40:55.049073 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] [instance: edf92675-15b4-424f-85b5-80341e77b578] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:40:55.076262 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Running cmd (subprocess): nvme version {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jun 26 10:40:55.099032 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: edf92675-15b4-424f-85b5-80341e77b578] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:40:55.111270 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: edf92675-15b4-424f-85b5-80341e77b578] Synchronizing instance power state after lifecycle event "Started"; current vm_state: shelved_offloaded, current task_state: spawning, current DB power_state: 4, VM power_state: 1 {{(pid=98967) handle_lifecycle_event /opt/stack/nova/nova/compute/manager.py:1540}} Jun 26 10:40:55.129251 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.processutils [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] 'nvme version' failed. Not Retrying. {{(pid=98967) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jun 26 10:40:55.129779 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.nvmeof [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] nvme not present on system {{(pid=98967) nvme_present /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/nvmeof.py:782}} Jun 26 10:40:55.143604 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] LIGHTOS: [Errno 111] Connection refused {{(pid=98967) find_dsc /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:161}} Jun 26 10:40:55.145762 np0000003731 nova-compute[98967]: INFO os_brick.initiator.connectors.lightos [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] Current host hostNQN and IP(s) are ['10.4.3.79', 'fe80::f816:3eff:fe55:ba34', '192.168.40.6', 'fe80::f816:3eff:fe6b:fe1a', '192.168.50.6', 'fe80::f816:3eff:feca:9cd0', '192.168.10.6', 'fe80::f816:3eff:feb4:4e78', '192.168.122.1', '172.24.5.1', '2001:db8::2', 'fe80::f8bb:38ff:fe28:ff4a', 'fe80::fc16:3eff:fe37:b3f6', 'fe80::41a:feff:fe02:479d', 'fe80::fc16:3eff:fe5e:459', 'fe80::fc16:3eff:fe90:be9c', 'fe80::84cb:23ff:fe8e:e6e6', 'fe80::fc16:3eff:fe5a:811a', 'fe80::fc16:3eff:fe1b:5509', 'fe80::fc16:3eff:fef2:781c', 'fe80::b448:c6ff:fe9c:a1e9', 'fe80::fc16:3eff:fea4:49e7', 'fe80::acbf:48ff:fe2a:f93b', 'fe80::fc16:3eff:fe0e:19b0', 'fe80::fc16:3eff:fe48:bca4', 'fe80::fc16:3eff:fe85:e3e8', 'fe80::fc16:3eff:fe80:7d0d', 'fe80::b8e9:eaff:feee:4936', 'fe80::fc16:3eff:fecb:d9dc', 'fe80::fc16:3eff:fe97:321f', 'fe80::1cb1:31ff:fe57:6a2', 'fe80::fc16:3eff:fe41:2f75', 'fe80::d41a:ddff:fe9f:a411'] Jun 26 10:40:55.146568 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] LIGHTOS: did not find dsc, continuing anyway. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:136}} Jun 26 10:40:55.146691 np0000003731 nova-compute[98967]: DEBUG os_brick.initiator.connectors.lightos [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] LIGHTOS: no hostnqn found. {{(pid=98967) get_connector_properties /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/initiator/connectors/lightos.py:145}} Jun 26 10:40:55.147025 np0000003731 nova-compute[98967]: DEBUG os_brick.utils [None req-849ab73d-2651-4ef8-a5f4-571f6ceb4a4f tempest-AttachVolumeMultiAttachTest-1668992443 tempest-AttachVolumeMultiAttachTest-1668992443-project-member] <== get_connector_properties: return (122ms) {'platform': 'x86_64', 'os_type': 'linux', 'ip': '10.4.3.79', 'host': 'np0000003731', 'multipath': True, 'enforce_multipath': True, 'initiator': 'iqn.2016-04.com.open-iscsi:2fddcc2116d6', 'do_local_attach': False, 'uuid': '8515de1c-ba7e-467b-adde-6d9f8a8dbc1f', 'system uuid': '7f2a0776-2f14-4357-a22e-baa6677eb22e', 'nvme_native_multipath': False} {{(pid=98967) trace_logging_wrapper /opt/stack/data/venv/lib/python3.12/site-packages/os_brick/utils.py:202}} Jun 26 10:40:55.160807 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Found default for hw_cdrom_bus of ide {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:40:55.160807 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Found default for hw_disk_bus of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:40:55.160807 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Found default for hw_input_bus of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:40:55.161736 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Found default for hw_pointer_model of None {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:40:55.162177 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Found default for hw_video_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:40:55.162587 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Found default for hw_vif_model of virtio {{(pid=98967) _register_undefined_instance_details /opt/stack/nova/nova/virt/libvirt/driver.py:1041}} Jun 26 10:40:55.204767 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7bd74cbb-2eed-49a7-ad20-6f0ef2753727 req-8573c899-153b-4a5c-aeb2-44a1e1b5baf0 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Received event network-vif-unplugged-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:55.205456 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7bd74cbb-2eed-49a7-ad20-6f0ef2753727 req-8573c899-153b-4a5c-aeb2-44a1e1b5baf0 service nova] Acquiring lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:55.205456 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7bd74cbb-2eed-49a7-ad20-6f0ef2753727 req-8573c899-153b-4a5c-aeb2-44a1e1b5baf0 service nova] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:55.206272 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-7bd74cbb-2eed-49a7-ad20-6f0ef2753727 req-8573c899-153b-4a5c-aeb2-44a1e1b5baf0 service nova] Lock "c8aff61a-5f59-4f8c-8288-abd5a7853474-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:55.206272 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7bd74cbb-2eed-49a7-ad20-6f0ef2753727 req-8573c899-153b-4a5c-aeb2-44a1e1b5baf0 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] No waiting events found dispatching network-vif-unplugged-93123956-587e-4fec-b4de-833327660f6e {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:55.206272 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-7bd74cbb-2eed-49a7-ad20-6f0ef2753727 req-8573c899-153b-4a5c-aeb2-44a1e1b5baf0 service nova] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Received event network-vif-unplugged-93123956-587e-4fec-b4de-833327660f6e for instance with task_state deleting. {{(pid=98967) _process_instance_event /opt/stack/nova/nova/compute/manager.py:11764}} Jun 26 10:40:55.237517 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c26ff41f-9cc1-4351-a147-a8514fbced30 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Acquiring lock "interface-619d915a-12c9-424f-8c12-b2a3f94a4109-3edf5060-42d2-4da0-8072-9aa340b3ddf5" by "nova.compute.manager.ComputeManager.detach_interface..do_detach_interface" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:55.237517 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-c26ff41f-9cc1-4351-a147-a8514fbced30 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lock "interface-619d915a-12c9-424f-8c12-b2a3f94a4109-3edf5060-42d2-4da0-8072-9aa340b3ddf5" acquired by "nova.compute.manager.ComputeManager.detach_interface..do_detach_interface" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:55.356090 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:55.384839 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:55.551613 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Swapping old allocation on dict_keys(['7149a1d0-8a83-4b86-a06a-b678e317ee9d']) held by migration 66b6aa46-c062-432a-9043-282c83c1c1b8 for instance Jun 26 10:40:55.565548 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-26ffc6c5-7ebb-42df-b0df-67aa7bf982c9 tempest-AttachVolumeShelveTestJSON-959960600 tempest-AttachVolumeShelveTestJSON-959960600-project-member] Lock "edf92675-15b4-424f-85b5-80341e77b578" "released" by "nova.compute.manager.ComputeManager.unshelve_instance..do_unshelve_instance" :: held 20.001s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:55.597764 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:55.605597 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:55.619266 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Paused> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:40:55.619481 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: edf92675-15b4-424f-85b5-80341e77b578] VM Paused (Lifecycle Event) Jun 26 10:40:55.665545 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-468c59a7-f3cc-441a-8e62-b715ddfee805 req-27a6737d-1766-47fb-9f68-b442dde79a16 service nova] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Received event network-vif-unplugged-b456b506-7aaf-4c28-a7ed-bcbb16898b49 {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:55.665545 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-468c59a7-f3cc-441a-8e62-b715ddfee805 req-27a6737d-1766-47fb-9f68-b442dde79a16 service nova] Acquiring lock "7edf2e67-5bc5-420a-8674-997ea5a30152-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:55.665545 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-468c59a7-f3cc-441a-8e62-b715ddfee805 req-27a6737d-1766-47fb-9f68-b442dde79a16 service nova] Lock "7edf2e67-5bc5-420a-8674-997ea5a30152-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:55.665884 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-468c59a7-f3cc-441a-8e62-b715ddfee805 req-27a6737d-1766-47fb-9f68-b442dde79a16 service nova] Lock "7edf2e67-5bc5-420a-8674-997ea5a30152-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:55.665884 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-468c59a7-f3cc-441a-8e62-b715ddfee805 req-27a6737d-1766-47fb-9f68-b442dde79a16 service nova] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] No waiting events found dispatching network-vif-unplugged-b456b506-7aaf-4c28-a7ed-bcbb16898b49 {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:55.665975 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-468c59a7-f3cc-441a-8e62-b715ddfee805 req-27a6737d-1766-47fb-9f68-b442dde79a16 service nova] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Received unexpected event network-vif-unplugged-b456b506-7aaf-4c28-a7ed-bcbb16898b49 for instance with vm_state active and task_state rescuing. Jun 26 10:40:55.670279 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:40:55.675505 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:55.716906 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:55.742535 np0000003731 nova-compute[98967]: DEBUG nova.scheduler.client.report [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Overwriting current allocation {'allocations': {'7149a1d0-8a83-4b86-a06a-b678e317ee9d': {'resources': {'VCPU': 1, 'MEMORY_MB': 256, 'DISK_GB': 1}, 'generation': 36}}, 'project_id': '13f2d75c17e64be5a0a5a2de4aaca2e7', 'user_id': '3d2ca60f7c4f4cb5a413138ae1f040a7', 'consumer_generation': 1} on consumer 3a56a898-691e-473e-a5c1-d618e861087b {{(pid=98967) move_allocations /opt/stack/nova/nova/scheduler/client/report.py:2036}} Jun 26 10:40:55.744623 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:55.747038 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-c26ff41f-9cc1-4351-a147-a8514fbced30 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lazy-loading 'flavor' on Instance uuid 619d915a-12c9-424f-8c12-b2a3f94a4109 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:55.750809 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [-] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Instance destroyed successfully. Jun 26 10:40:55.752356 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-28d97658-341e-49ab-a4bc-6d172c3ddcff tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] Lazy-loading 'numa_topology' on Instance uuid 7edf2e67-5bc5-420a-8674-997ea5a30152 {{(pid=98967) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1148}} Jun 26 10:40:55.759474 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:55.784954 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-640b4a9a-6ff1-469a-9ae8-dc8fbd3b111e req-fb8f83b3-d4f6-4978-be1a-913a1d2343f2 service nova] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Received event network-vif-plugged-288e6be4-7ae8-4847-ad8e-a0b0b95afa6d {{(pid=98967) external_instance_event /opt/stack/nova/nova/compute/manager.py:11988}} Jun 26 10:40:55.786700 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-640b4a9a-6ff1-469a-9ae8-dc8fbd3b111e req-fb8f83b3-d4f6-4978-be1a-913a1d2343f2 service nova] Acquiring lock "3dd6ac52-de12-47da-bc90-77d0fff44acf-events" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:55.786700 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-640b4a9a-6ff1-469a-9ae8-dc8fbd3b111e req-fb8f83b3-d4f6-4978-be1a-913a1d2343f2 service nova] Lock "3dd6ac52-de12-47da-bc90-77d0fff44acf-events" acquired by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:55.786700 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [req-640b4a9a-6ff1-469a-9ae8-dc8fbd3b111e req-fb8f83b3-d4f6-4978-be1a-913a1d2343f2 service nova] Lock "3dd6ac52-de12-47da-bc90-77d0fff44acf-events" "released" by "nova.compute.manager.InstanceEvents.pop_instance_event.._pop_event" :: held 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:55.786837 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [req-640b4a9a-6ff1-469a-9ae8-dc8fbd3b111e req-fb8f83b3-d4f6-4978-be1a-913a1d2343f2 service nova] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] No waiting events found dispatching network-vif-plugged-288e6be4-7ae8-4847-ad8e-a0b0b95afa6d {{(pid=98967) pop_instance_event /opt/stack/nova/nova/compute/manager.py:343}} Jun 26 10:40:55.787556 np0000003731 nova-compute[98967]: WARNING nova.compute.manager [req-640b4a9a-6ff1-469a-9ae8-dc8fbd3b111e req-fb8f83b3-d4f6-4978-be1a-913a1d2343f2 service nova] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Received unexpected event network-vif-plugged-288e6be4-7ae8-4847-ad8e-a0b0b95afa6d for instance with vm_state active and task_state rebuild_spawning. Jun 26 10:40:55.835959 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [-] [instance: c8aff61a-5f59-4f8c-8288-abd5a7853474] Updating instance_info_cache with network_info: [] {{(pid=98967) update_instance_cache_with_nw_info /opt/stack/nova/nova/network/neutron.py:106}} Jun 26 10:40:55.915713 np0000003731 nova-compute[98967]: WARNING neutronclient.v2_0.client [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] The python binding code in neutronclient is deprecated in favor of OpenstackSDK, please use that as this will be removed in a future release. Jun 26 10:40:55.944021 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:55.952438 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:56.018115 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquiring lock "refresh_cache-3a56a898-691e-473e-a5c1-d618e861087b" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jun 26 10:40:56.018716 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] Acquired lock "refresh_cache-3a56a898-691e-473e-a5c1-d618e861087b" {{(pid=98967) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jun 26 10:40:56.018716 np0000003731 nova-compute[98967]: DEBUG nova.network.neutron [None req-de80e5c8-119a-4a58-83b4-4c42b02a4d1d tempest-ServerActionsTestOtherB-576427951 tempest-ServerActionsTestOtherB-576427951-project-member] [instance: 3a56a898-691e-473e-a5c1-d618e861087b] Building network info cache for instance {{(pid=98967) _get_instance_nw_info /opt/stack/nova/nova/network/neutron.py:2049}} Jun 26 10:40:56.020497 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-bfc54a30-2804-4db2-8515-8235a3717066 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Lock "619d915a-12c9-424f-8c12-b2a3f94a4109" "released" by "nova.compute.manager.ComputeManager.detach_volume..do_detach_volume" :: held 4.131s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jun 26 10:40:56.125032 np0000003731 nova-compute[98967]: DEBUG nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: edf92675-15b4-424f-85b5-80341e77b578] Checking state {{(pid=98967) _get_power_state /opt/stack/nova/nova/compute/manager.py:1957}} Jun 26 10:40:56.126750 np0000003731 nova-compute[98967]: DEBUG nova.virt.driver [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] Emitting event Resumed> {{(pid=98967) emit_event /opt/stack/nova/nova/virt/driver.py:1874}} Jun 26 10:40:56.126932 np0000003731 nova-compute[98967]: INFO nova.compute.manager [None req-ae5f012d-e2e3-4574-901d-0bde06fd83e0 None None] [instance: edf92675-15b4-424f-85b5-80341e77b578] VM Resumed (Lifecycle Event) Jun 26 10:40:56.166752 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:56.175313 np0000003731 nova-compute[98967]: DEBUG ovsdbapp.backend.ovs_idl.vlog [-] [POLLIN] on fd 18 {{(pid=98967) __log_wakeup /opt/stack/data/venv/lib/python3.12/site-packages/ovs/poller.py:263}} Jun 26 10:40:56.203836 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Acquiring lock "compute_resources" by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jun 26 10:40:56.203836 np0000003731 nova-compute[98967]: DEBUG oslo_concurrency.lockutils [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] Lock "compute_resources" acquired by "nova.compute.resource_tracker.ResourceTracker.finish_evacuation" :: waited 0.000s {{(pid=98967) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jun 26 10:40:56.203836 np0000003731 nova-compute[98967]: DEBUG nova.objects.instance [None req-67fbedba-8aa1-4c0f-b940-05008930dfdd tempest-ServerActionsV293TestJSON-1674673586 tempest-ServerActionsV293TestJSON-1674673586-project-member] [instance: 3dd6ac52-de12-47da-bc90-77d0fff44acf] Trying to apply a migration context that does not seem to be set for this instance {{(pid=98967) apply_migration_context /opt/stack/nova/nova/objects/instance.py:1074}} Jun 26 10:40:56.268813 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.vif [None req-c26ff41f-9cc1-4351-a147-a8514fbced30 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] vif_type=ovs instance=Instance(access_ip_v4=None,access_ip_v6=None,architecture=None,auto_disk_config=False,availability_zone='nova',cell_name=None,cleaned=False,compute_id=1,config_drive='True',created_at=2026-06-26T10:39:32Z,default_ephemeral_device=None,default_swap_device=None,deleted=False,deleted_at=None,device_metadata=InstanceDeviceMetadata,disable_terminate=False,display_description=None,display_name='tempest-device-tagging-server-1329602566',ec2_ids=,ephemeral_gb=0,ephemeral_key_uuid=None,fault=,flavor=Flavor(11),hidden=False,host='np0000003731',hostname='tempest-device-tagging-server-1329602566',id=23,image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',info_cache=InstanceInfoCache,instance_type_id=11,kernel_id='',key_data='ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAPv9SUt9TdjN5OZ4Ypk2xTwDqORSk7I6hErYKR7wNppYsK22T4j5VWZStNGf7JdUDmoiKJG45UqJOBREGbXYHEWrXxZJ7lAQaFPzSP5N0HdEGBWxH/KmemEWI0PPG+MHA==',key_name='tempest-keypair-1334314580',keypairs=,launch_index=0,launched_at=2026-06-26T10:39:48Z,launched_on='np0000003731',locked=False,locked_by=None,memory_mb=192,metadata={},migration_context=,new_flavor=None,node='np0000003731',numa_topology=,old_flavor=None,os_type=None,pci_devices=,pci_requests=,power_state=1,progress=0,project_id='4d10b4c2e162455786d5aa40d72a31c7',ramdisk_id='',reservation_id='r-dhr2xu20',resources=,root_device_name='/dev/vda',root_gb=1,security_groups=SecurityGroupList,services=,shutdown_terminate=False,system_metadata={boot_roles='reader,member',image_base_image_ref='a9b18127-6fee-4ed6-b364-a2d634ecb8b7',image_container_format='bare',image_disk_format='qcow2',image_hw_cdrom_bus='ide',image_hw_disk_bus='virtio',image_hw_input_bus=None,image_hw_machine_type='pc',image_hw_pointer_model=None,image_hw_rng_model='virtio',image_hw_video_model='virtio',image_hw_vif_model='virtio',image_min_disk='1',image_min_ram='0',image_os_glance_failed_import='',image_os_glance_importing_to_stores='',image_owner_specified.openstack.md5='',image_owner_specified.openstack.object='images/cirros-0.6.3-x86_64-disk',image_owner_specified.openstack.sha256='',owner_project_name='tempest-TaggedAttachmentsTest-1829838869',owner_user_name='tempest-TaggedAttachmentsTest-1829838869-project-member'},tags=,task_state=None,terminated_at=None,trusted_certs=,updated_at=2026-06-26T10:39:48Z,user_data='IyEvYmluL3NoCmVjaG8gIlByaW50aW5nIGNpcnJvcyB1c2VyIGF1dGhvcml6ZWQga2V5cyIKY2F0IH5jaXJyb3MvLnNzaC9hdXRob3JpemVkX2tleXMgfHwgdHJ1ZQo=',user_id='2182fde17d0f447c971e388b65911648',uuid=619d915a-12c9-424f-8c12-b2a3f94a4109,vcpu_model=,vcpus=1,vm_mode=None,vm_state='active') vif={"id": "3edf5060-42d2-4da0-8072-9aa340b3ddf5", "address": "fa:16:3e:80:7d:0d", "network": {"id": "d31aa207-2dbc-4f10-a12c-622a7ebf9af7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-108444478", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d10b4c2e162455786d5aa40d72a31c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edf5060-42", "ovs_interfaceid": "3edf5060-42d2-4da0-8072-9aa340b3ddf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} virt_type=qemu {{(pid=98967) get_config /opt/stack/nova/nova/virt/libvirt/vif.py:601}} Jun 26 10:40:56.269130 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c26ff41f-9cc1-4351-a147-a8514fbced30 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Converting VIF {"id": "3edf5060-42d2-4da0-8072-9aa340b3ddf5", "address": "fa:16:3e:80:7d:0d", "network": {"id": "d31aa207-2dbc-4f10-a12c-622a7ebf9af7", "bridge": "br-int", "label": "tempest-tagged-attachments-test-net-108444478", "subnets": [{"cidr": "10.10.10.0/24", "dns": [], "gateway": {"address": "10.10.10.1", "type": "gateway", "version": 4, "meta": {}}, "ips": [{"address": "10.10.10.93", "type": "fixed", "version": 4, "meta": {}, "floating_ips": []}], "routes": [], "version": 4, "meta": {"enable_dhcp": true}}], "meta": {"injected": false, "tenant_id": "4d10b4c2e162455786d5aa40d72a31c7", "mtu": 1372, "physical_network": null, "tunneled": true}}, "type": "ovs", "details": {"port_filter": true, "connectivity": "l2", "ovs_create_tap": false, "bridge_name": "br-int", "datapath_type": "system", "bound_drivers": {"0": "ovn"}}, "devname": "tap3edf5060-42", "ovs_interfaceid": "3edf5060-42d2-4da0-8072-9aa340b3ddf5", "qbh_params": null, "qbg_params": null, "active": true, "vnic_type": "normal", "profile": {}, "preserve_on_delete": false, "delegate_create": true, "meta": {}} {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:511}} Jun 26 10:40:56.269935 np0000003731 nova-compute[98967]: DEBUG nova.network.os_vif_util [None req-c26ff41f-9cc1-4351-a147-a8514fbced30 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Converted object VIFOpenVSwitch(active=True,address=fa:16:3e:80:7d:0d,bridge_name='br-int',has_traffic_filtering=True,id=3edf5060-42d2-4da0-8072-9aa340b3ddf5,network=Network(d31aa207-2dbc-4f10-a12c-622a7ebf9af7),plugin='ovs',port_profile=VIFPortProfileOpenVSwitch,preserve_on_delete=False,vif_name='tap3edf5060-42') {{(pid=98967) nova_to_osvif_vif /opt/stack/nova/nova/network/os_vif_util.py:550}} Jun 26 10:40:56.274228 np0000003731 nova-compute[98967]: INFO nova.virt.libvirt.driver [None req-28d97658-341e-49ab-a4bc-6d172c3ddcff tempest-ServerBootFromVolumeStableRescueTest-618712607 tempest-ServerBootFromVolumeStableRescueTest-618712607-project-member] [instance: 7edf2e67-5bc5-420a-8674-997ea5a30152] Attempting a stable device rescue Jun 26 10:40:56.281174 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-c26ff41f-9cc1-4351-a147-a8514fbced30 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] looking for interface given config: {{(pid=98967) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}} Jun 26 10:40:56.287448 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-c26ff41f-9cc1-4351-a147-a8514fbced30 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] looking for interface given config: {{(pid=98967) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}} Jun 26 10:40:56.292175 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.driver [None req-c26ff41f-9cc1-4351-a147-a8514fbced30 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] Attempting to detach device tap3edf5060-42 from instance 619d915a-12c9-424f-8c12-b2a3f94a4109 from the persistent domain config. {{(pid=98967) _detach_from_persistent /opt/stack/nova/nova/virt/libvirt/driver.py:2632}} Jun 26 10:40:56.292423 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-c26ff41f-9cc1-4351-a147-a8514fbced30 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] detach device xml: Jun 26 10:40:56.292423 np0000003731 nova-compute[98967]: Jun 26 10:40:56.292423 np0000003731 nova-compute[98967]: Jun 26 10:40:56.292423 np0000003731 nova-compute[98967]: Jun 26 10:40:56.292423 np0000003731 nova-compute[98967]: Jun 26 10:40:56.292423 np0000003731 nova-compute[98967]: Jun 26 10:40:56.292423 np0000003731 nova-compute[98967]: Jun 26 10:40:56.292423 np0000003731 nova-compute[98967]: {{(pid=98967) detach_device /opt/stack/nova/nova/virt/libvirt/guest.py:481}} Jun 26 10:40:56.298617 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-c26ff41f-9cc1-4351-a147-a8514fbced30 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] looking for interface given config: {{(pid=98967) get_interface_by_cfg /opt/stack/nova/nova/virt/libvirt/guest.py:251}} Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: DEBUG nova.virt.libvirt.guest [None req-c26ff41f-9cc1-4351-a147-a8514fbced30 tempest-TaggedAttachmentsTest-1829838869 tempest-TaggedAttachmentsTest-1829838869-project-member] interface for config: not found in domain: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: instance-00000017 Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: 619d915a-12c9-424f-8c12-b2a3f94a4109 Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: tempest-device-tagging-server-1329602566 Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: 2026-06-26 10:40:34 Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: 192 Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: 0 Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: 0 Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: True Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: bare Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: qcow2 Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: 0 Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: ide Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: virtio Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: pc Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: virtio Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: virtio Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: virtio Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: tempest-TaggedAttachmentsTest-1829838869-project-member Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: tempest-TaggedAttachmentsTest-1829838869 Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: 196608 Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: 196608 Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: 1 Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: /machine Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: OpenStack Foundation Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: OpenStack Nova Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: 33.1.0 Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: 619d915a-12c9-424f-8c12-b2a3f94a4109 Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: 619d915a-12c9-424f-8c12-b2a3f94a4109 Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Virtual Machine Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: hvm Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: 131072 Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Nehalem Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: destroy Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: restart Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: destroy Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: /usr/bin/qemu-system-x86_64 Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]:
Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]:
Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]:
Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]:
Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]:
Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: Jun 26 10:40:56.300634 np0000003731 nova-compute[98967]: